Google offers a smart option for you to auto grouping your picture with its AI. It seems that Google turned such feature on by default, however, you can turn it off if you don’t like it. Another option is to remove geo location of the photos you shared by link, if you turn it on, the geo location of the photos will be removed.
Note that this option may not be displayed if the user never user Google Photo service.