Q. For non-loop tracks, will I be able to make them loop with the standard Windows playback programs?
A. In general, the answer is yes. Most audio player software programs have a feature where they can be made to play a single track over and over again. It all depends on the specific features and functionality available in the specific player(s) you are trying to use.
Structurally there is no difference between a file designated as a loop and one that isn't. Both types of tracks are just standard audio files that usually play from the start to the finish and then the player simply stops once the end is reached. If you put your player in a looping mode, rather than stopping when it gets to the end of the file, it starts over at the beginning again and plays the file over and over, end-to-end.
The difference between a "loop" file and a non-loop file is in how the sound that is contained in the file is structured. Loop tracks are meant to be played such that it sounds like continuously playing music when the track starts over from the beginning. As such, most loop sounds have abrupt beginnings and endings so that it plays continuously end to end, and with no audible interruption when it starts back playing at the beginning again.
For a non-loop track, it is not generally created to play seamlessly from end to end, but if you put your player in loop mode, it will play the track over and over again in a continuous loop. But because the track is not structured to be a loop specifically, each time the track starts over it may be fairly apparent to the listener that the track has started over again from the beginning.