Part 1. Definition
You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
Part 2. Example
System Reference: x is a reasonably priced fast food restaurant down by river cheap.
Original Reference: x is a cheap fastfood restaurant located near the riverside.
Answer: 1
Explanation: The system reference could have been uttered by a native speaker.
Part 3. Exercise
System Reference: so you are looking for something in the pricey price range, is that correct?
Original Reference: i would like to confirm that you are looking for a pricey hotel.
Answer:
0