You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
One example is below.
Q: System Reference: x is a reasonably priced fast food restaurant down by river cheap.
Original Reference: x is a cheap fastfood restaurant located near the riverside.
A: 1
Rationale: The system reference could have been uttered by a native speaker.
Q: System Reference: can i double check you want a hotel that has internet?
Original Reference: do you need a hotel with internet?.
A:
0