"Living in New York, apartments cost more to rent than they do in other smaller
cities."

Please help me point out what is wrong with above sentence and explain why.
Thanks.

This is called a dangling modifier. Apartments don't live in New York. Start you sentence 'In New York, apartments...' and you're fine.