Support for SermonSpeaker 4.x is canceled as it is for Joomla 2.5. I will gladly assist you with minor issues but I will not fix any bugs anymore in this releases.
The fix is to upgrade to SermonSpeaker 5.x and Joomla 3.x, which is better anyway.
Based on categories: yes.
Based on series or speakers: no.
You can do so by either set the filter options in a menu entry or by using the URL parameters "&sermon_cat=12", "&speaker_cat=12" or "&series_cat=12" where you replace "12" with the id of your category.