Remember that this is an experimental itinerary. Try to mess around with scheduling and alternative ways of travel.
Resources you may like to reference:
Uber Fare Estimator:
While it won't get you all the way there, it can help you at some legs of the trip. Use when flexibility is ideal.
Amtrak, considering the distance traveled, can be moderately pricey, but otherwise swift. Strongly recommended to buy tickets months in advance to avoid demand-related surge pricing. Acela lines are business class, and marginally faster than Northeast Regionals, but are more than double the price! ($180 vs $80) Another note: Round Trip tickets offer a reduced rate on the return ticket. Combine with getting a non-peak hour ticket, and watch your costs drop more.
Newark Penn.Station = NWK
Baltimore Penn. Station = BAL
Maryland Transit Administration:
Your route of interest is most certainly Route 3, assuming the Amtrak option. Bus fare is $1.70.
Most certainly your first leg of the journey, based on the vague location of Port Jervis. Your route of Interest is named "Main/Bergen/Port Jervis". I question the $20.25 fare, actually. Might want to contact NJ Transit about that.
Ideally, I might suggest buying round-trip Newark to Baltimore tickets, while taking an Uber to Newark's station. Alternatively, you can ask friends/family for a ride, thus cutting costs further.