Blacklist should be renamed "The James Spader Show", because that's really the only reason to watch it. The plot points and the scenes that directly involve him, or his immediate supporting characters (his crew) are the most interesting.
The rest of it, the whole FBI side is a sideshow and those characters can't compete on screen with James Spader who overshadows everything else to do with the show.