Only in the feminine form of the word. In the masculine form it does mean evil.
H7451
ra? ra^a^h
rah, raw-aw'
From H7489; bad or (as noun) evil (naturally or morally). This includes the second (feminine) form; as adjective or noun: - adversity, affliction, bad, calamity, + displease (-ure), distress, evil ([-favouredness], man, thing), + exceedingly, X great, grief (-vous), harm, heavy, hurt (-ful), ill (favoured), + mark, mischief, (-vous), misery, naught (-ty), noisome, + not please, sad (-ly), sore, sorrow, trouble, vex, wicked (-ly, -ness, one), worse (-st) wretchedness, wrong. [Including feminine ra’ah; as adjective or noun.]
Essentially the word means literal evil when it's in the masculine form, or can mean "turmoil or calamity" if it's in the feminine form. In the masculine form it can mean natural evil or moral evil. God is fully moral so the evil God creates is not morally evil but is known as "natural evil" which means something bad mainly from the perspective of those receiving the evil from God. Example: When God rained fire from heaven on Sodom, the people would consider that receiving evil from God because burning to death is painful. They deserved this fate so it was not morally evil to kill them in this sense.