Ok, after some digging, I found out that the problem I had was with the tubing that goes into the venturi.
I don't have a check valve on the tubing. Not sure if it would be wise to use one anyway.
As I turn the skimmer off for maintenance, the tubing fills up with water.
That water is...