FYI: For Flux, there is a lot more power in the text-encoder & you can prompt with more meaningful and comprehensive sentences. Thus, less of the traditional comma separated & concise phrasing we saw in stable diffusion.
You should do the same with your training images. Caption everything you do not want the model to remember as "you" (what you're doing, wearing, accompanied by, accessories, etc).
You can do that, but you can also just do your name (or, I do two prompts - one the name, the other “A photo of _name_” as that makes it easier to prompt non-photographic images). This has the bonus of not training that particular shirt or whatever in, so if you prompt for something similar it won’t be identical.
That said I usually train with about 100 really varied images of the person so it tends not to overlearn any other particular thing.
You should do the same with your training images. Caption everything you do not want the model to remember as "you" (what you're doing, wearing, accompanied by, accessories, etc).