I have juiced oranges and lemons over the years and have not had any problems with seeds causing the juice to have a bitter taste. Make sure you are remove the orange peeling before you juice the orange. The orange peel is indigestible to humans. The peeling also is very bitter, which could be the reason why your juice taste bitter.
