Yeah unfortunately it doesn't get much more difficult than what you're playing now. I usually level up as much as possible in these games doing side missions etc. If it wasn't for the story I wouldn't be playing it much there was only one fight that really gave me trouble, and granted I haven't beaten the game but really if you save your fateshifts for final bosses or cave bosses you shouldn't really come close to dying.