Actually that verse is Psalm 119:165 And your using literally the only translation that uses the word "offend" instead of "stumble". In modern English it gives the wrong understanding of the verse.
"Great peace have those who love your law; nothing can make them stumble."
Not stumbling (in faith) is different than nothing can make you feel offended.
Jesus Himself felt offense, and displayed righteous indignation - which is anger in English.
The Strong's Exhaustive concordance at the biblehub lists "offence" among the meaning of the Hebrew word
Kashal that most bible versions translate to stumble or stumbling block or fall. But "stumble" is not a direct opposite of peace. So I chose the optional "offence".
The word "stumble" is referring to those who don't love God's law, ie, unbelievers. As describing those whom Paul preached to toward the end of Acts but didn't accept the gospel.
But the word "offence" would refer to those who do love God's word- such as your example of Jesus.
Checking religious images available for Ps.119:165, there are many that use the word "offend" rather than the word "stumble". They are using "offense" in connection with depicted believers who love God's law.
You said that there is only one translation that uses the word offend. There are actually six I've found of Modern English Bibles that have the word "offend" The Ampl.Classic. And the King James, 2000 KJ, American KJ. Plus two older Bibles that have "offended, offende" are the less Modern- Bishop 1568 and Coverdale of 1535.
I read several different Bible versions and use Biblehub, Gateway, and BlueLetterBible for comparison of many of their Bible versions.
You have your valid reasons for using "Stumble", I have my valid reasons for using "Offense" or variations of that word.