If I understand you correctly you're happy with the count per order (ie 1234 = 20) but what you're not happy with is the Grand Total saying 167 instead of 4...is this what you want (4)? If so what I would do, again not being familiar with Pivots, is just put a summary row above your pivot that does a count of column A...I tried this on your spreadsheet and it gave me a result of 4. You could put some fancy formatting and add the grand total count as well and it would look professional...see attached:
FYI there's a formula in D1 but the font is white to keep it from being visible...you could protect this if need be.