When playing in 1.16, some chunks are newly generated where there should be the map. Is being inside those chunks considered OOB?

Technically yeah because the chunks were inverted to natural chunks.