Can I run a business without actually being setup as an LLC, Inc., etc?

When do I need to register my business? How much profit can I aculate or how long can I be in business before doing this? What are the repercussions or benefits if I do not register?