No. PaginationLimitedTo[1] will increase the maximum number of hits that can be returned. It won't affect indexing. The performance impacts are related to the increase in the number of records that need to be processed and returned.
Links
[1]: paginationLimitedTo