If you run command ls -la from the various tmp folders in your system you will see that most of the files or folders are root owned so you should nt remove them.
Some may be owned by you as user so are probably safer to remove if you want to but generally, why bother? Most of those tmp files or folders are very small and cause no problems.