Is one word against another enough to go to court?

You need to corroborate your accusation. You can do this through detailed doentation of the events (dates, times, locations, ect). Witness to the crime can also be helpful, you must also show where you and your ailant/ ailants were at those dates and times ( putting you together on the same time line). You see this in cases of childhood and molestation. Cases like these are not easy to prove, in most cases it takes corroborating testimony from other victims to bring this to court.