The word "ordinances" is not just referring to ceremonial law.
Ordinance is a decree or law
Psalm119:91 has nothing to do with cermonial law.
119:89 For ever, O LORD, thy word is settled in heaven.
119:90 Thy faithfulness is unto all generations: thou hast established the earth, and it abideth.
119:91 They continue this day according to thine ordinances: for all are thy servants.
It depends what the within chapter and scripture context is talking about. The OP is SHADOW laws of COL 2 linking the OLD to the NEW.
So the context from COL 2:14 with v11-13 in reference to circumcision of a new heart (Old pointing to the new) leading to v14 in reference to handwriting of
ORDINANCES; (G1378) dogma δόγμα; dogma dog'-mah; From the base of G1380; a
law; civil, ceremonial or ecclesiastical: - decree, ordinance, which continues the discussion on the SHADOW laws from the MOSAIC BOOK OF THE COVENANT.
This is already answered in the OP BTW.
COLOSIANS 2 [14], Blotting out the
HANDWRITING of ORDINANCES that was against us, which was contrary to us, and took it out of the way, nailing it to his cross;
HEBREWS 9 [1] Then verily
THE FIRST COVENANT HAD ALSO ORDINANCES of divine service, and a worldly sanctuary. [9] Which was a figure for the time then present, in which were offered both gifts and sacrifices, that could not make him that did the service perfect, as pertaining to the conscience;[10]
WHICH STOOD ONLY IN MEATS AND DRINKS, and divers washings, and carnal ordinances, imposed on them until the time of reformation.[12] NEITHER BY THE BLOOD OF
GOATS AND CALVES, BUT BY HIS OWN BLOOD he entered in once into the holy place, having obtained eternal redemption for us.
EPHESIANS 2 [15] HAVING ABOLISHED in his flesh the enmity, even the
LAW OF COMMANDMENTS CONTAINED IN ORDINANCES; for to make in himself of twain one new man, so making peace;[16] And that he might reconcile both unto God in one body by the cross, having slain the enmity thereby:
EZEKIEL 46 [14] And thou shalt prepare a meat offering for it every morning, the sixth part of an ephah, and the third part of an hin of oil, to temper with the fine flour; a
MEAT OFFERING continually by a perpetual
ORDINANCE unto the LORD.
NUMBERS 19 [2] This is the
ORDINANCE OF THE LAW which the Lord hath commanded, saying, Speak unto the children of Israel, that they bring thee a red heifer without spot, wherein is no blemish, and upon which never came yoke.
You get the idea here.