It's fine. Depending on the context, you might consider adding the word "only" to add extra emphasis to the fact that the first goal was scored very early in the match:

"The match had only just started when they scored the first goal".




PaulM