[FEA] Port the logic at page_data.cu:282 to use `thread_group`s and avoid the magic 32 multiples.

[mhaseeb123]

We should probably port the whole logic at page_data.cu:282 and elsewhere where used to thread_groups and avoid the magic 32 multiples.

Originally posted by @vuule in #16109 (comment)