Also the docs say that dropping tables should free their memory:

"Running DROP TABLE should free the memory used by the table"

Source: https://duckdb.org/docs/stable/sql/statements/drop