hidden usage still causing significant performance loss
The joining of the hidden table to remove entries that have been marked hidden is still causing a MASSIVE performance hit. Examples as follows
Hidden Join Removed: 0.0862s
Current Usage: 0.5054s
NOT IN Usage: 0.2121s
The NOT IN usage seams to be a possible better alternative. Simply query for and organize all the hidden entries, add them to the query as NOT IN statements where appropriate as part of the WHERE, and a pretty decent performance gain is achieved. Currently the performance gets worse and worse the more activity that is hidden.
Review other possible solutions as current JOIN usage is simply not acceptable and far too slow.