If you're curious about what's happened with your hymen, one of these three ways to tell for sure should answer your question. Those holes might stretch or even break during rigorous activity, like horseback riding. The hymen has several natural holes on it, and these holes stretch open with time and activity.
So yes the hymen can definitely be broken without sex, and in fact, it usually is! My boyfriend popped my cherry when he fingered me hard and deep and he kept moving his fingers back and forth, which made me very horny. But the confusion doesn't end there.