Four to eight hours is completely normal for a first build. The videos are people who have done thirty of them, with the parts already sorted, editing out the boring parts.
Where your time actually went, roughly: switch soldering is 136 joints and at a genuinely careful pace that is an hour and a half. Stabilisers, if you tuned them, is another hour on a first attempt. Testing and inspecting is where beginners spend the rest, and that is time well spent.
An order that saves an hour next time. Test the PCB with tweezers before soldering anything. Do the stabilisers completely, and test them by hand, before any switch goes in, because reaching a stab under installed switches is miserable. Put in the four corner switches, snap the plate on, check it is square, then solder those four, then the rest. Flash the firmware before you install every keycap.
Second build will be two hours. Third will be ninety minutes and you will stop counting.