Skip to content

"sentences_used" field is inaccurate or wrong? #7

@xiangkaiz

Description

@xiangkaiz

I think some "sentences_used" field is inaccurate or wrong. For example:

The article is:
"paragraph": {"text": "<b>Sent 0: </b>timothy likes to play sports .<br><b>Sent 1: </b>he spends his time after school playing basketball and baseball .<br><b>Sent 2: </b>sometimes timothy pretends he is a famous baseball pitcher for his favorite team with his friends .<br><b>Sent 3: </b>he plays with his friends mandy and andrew .<br><b>Sent 4: </b>timothy also plays pretend when he is alone .<br><b>Sent 5: </b>he has an imaginary friend named sean .<br><b>Sent 6: </b>sean is an elephant who watches television with timothy .<br><b>Sent 7: </b>mandy likes playing baseball but she also likes to paint .<br><b>Sent 8: </b>mandy 's favorite class at school is art .<br><b>Sent 9: </b>she likes making pictures of flowers .<br><b>Sent 10: </b>her teacher says she is a good artist .<br><b>Sent 11: </b>she painted a picture of a tree for her teacher .<br><b>Sent 12: </b>there were red and yellow leaves on it .<br><b>Sent 13: </b>it had apples on it .<br><b>Sent 14: </b>when andrew goes home after baseball , he likes to eat a snack .<br><b>Sent 15: </b>he eats carrots and bananas .<br><b>Sent 16: </b>if he is a good boy his mom , mrs. smith , sometimes gives him milk and cookies .<br><b>Sent 17: </b>afterwards , andrew finishes his homework .<br><b>Sent 18: </b>"

The question and answer is:

{"multisent": false, "question": "who does timothy play with ?", "sentences_used": [0, 1], "answers": [{"text": "timothy plays with mandy and andrew . timothy also plays with his imaginary friend sean", "isAnswer": true, "scores": {}}, {"text": "the famous baseball pitcher", "isAnswer": false, "scores": {}}, {"text": "mrs smith", "isAnswer": false, "scores": {}}, {"text": "timothy likes to play sports", "isAnswer": false, "scores": {}}, {"text": "basketball and baseball", "isAnswer": false, "scores": {}}], "idx": "18"}

We can see clearly that we cannot answer this question or ask this question just base on sentence 0 and sentence 1.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions