How does the Building Department know if the structure was placed in the location proposed?

For all new house and for additions which are close to the required setbacks, a certified "as-built" plot plan must be submitted to the Building Department after completion of the foundation.  Framing cannot proceed until the plot plan has been submitted.