The word "church" is a Greek translation from the Hebrew word "ecclesia". Ecclesia is in the "Old" Testament too and just means a gathering of believers. No, you can search from Genesis to Revelation and never see anyting saying you have to go to Church.
The 4th Commandment spells out what we are to do on the Sabbath. Also, Isaiah 58 is helpful. Now people may say that the Commandments have been done away with. No, Scriptures say they are "for all generations." Further the Scriptures tell us YHWH, aka God, "never changes." Also we are told in Scripturres that He "will not alter" what has gone out of His mouth. What went out of His mouth, audibly to the people at the foot of Mt. Sinai, was the 10 Commandments.
The 4th Commandment says nothing about Church. It says to rest on the Sabbath, to honor it. The early Christian never heard of a Church. The Scriptures show they met in Synagogues on the Sabbath (though you are not commlanded to do that, though of course it was okay for them to do that if they wished) or in one another's homes. They never heard of a big buildling with a cross on top.
People will go to Church on Sundays and feel they have done their duty by the 4th Commandment. Then they go out to eat where other people have to wait on them (the 4th Commandments says to let servants, even animals, rest) and will maybe do work on their computers, even in their offices. They go shopping though in Scriptures we see YHWH coming down big time on people for just buying fish at the gates on the Sabbath.
Messiah said, speaking of the time coming after His resurrection, "Pray that your flight" from the marauding Romans to come "not be in the winter or on the Sabbath." Obviously, He never changed the Sabbath and wanted people to rest then. How could He change what the Father has written? He and the Father are one and, again, "YHWH changes not."
Praying you will learn how to keep the Sabbath holy, not by traditions of men, but by what the Scriptures actually say, and that you will find it to be a holy day of rest for yourself and your household.
From the Amplified Bible: Exodus 20:8-11
8 [Earnestly] remember the Sabbath day, to keep it holy (withdrawn from common employment and dedicated to God).
9 Six days you shall labor and do all your work,
10 But the seventh day is a Sabbath to the Lord your God; in it you shall not do any work, you, or your son, your daughter, your manservant, your maidservant, your domestic animals, or the sojourner within your gates.
11 For in six days the Lord made the heavens and the earth, the sea, and all that is in them, and rested the seventh day. That is why the Lord blessed the Sabbath day and hallowed it [set it apart for His purposes].