There are a variety of local, state and federal regulations that can apply to starting a business including everything from local zoning to obtaining a federal tax identification number.
The most common areas of concern for new businesses are:
State and local licenses may also be required.
You may want to check out the Getting Started - Startup Your Business page on this website.