Even if this might be true, including a license of some kind is really a best practice at this point. Something like a Creative Commons license is probably more appropriate than the MIT license, but when there's an explicit license there's no doubt about what your rights are.
The weights are not included in the git tree and are thus not covered by the LICENSE file. They are automatically downloaded when you run the code.
EDIT: following your comment, I have added a point-by-point breakdown of licensing information in the README. This will avoid any confusion.