I ran my system at that or higher for years, and there weren't any issues.
Why do you want to lower it?
Water changes are not a good way to lower phosphate, specially at that low level. Phosphate can often bounce up after a quick lowering as it can be sequestered in all kinds of substrate. If...