Below are the evaluation results of the RAGAS model on the test dataset. The evaluation metrics include answer relevancy, answer correctness, and semantic similarity. The evaluation results are based on the following metrics:
The evaluation results are presented in the table below:
| user_input | response | reference | answer_relevancy | answer_correctness | semantic_similarity |
|---|---|---|---|---|---|
| What are the first aid measures for high fever in infants? | For infants 0-3 months with a rectal temperature of 100.4oF (38oC) or higher, refer to a doctor, even if the child does not have any other signs or symptoms. For infants 3-6 months with a rectal temperature up to 102oF (38.9oC), encourage the child to rest and drink plenty of fluids. Medication is not needed. If the fever does not respond to the medication within one day, refer to the doctor. | ['For infants aged 0-3 months with a rectal temperature of 100.4oF (38oC) or higher, refer to the doctor even if the child does not have any other signs or symptoms. For infants aged 3-6 months with a rectal temperature up to 102oF (38.9oC), encourage the child to rest and drink plenty of fluids without the need for medication. If the child seems unusually irritable, lethargic, or uncomfortable, refer to the doctor.'] | 0.928155 | 0.846153 | 0.984611 |
| What are the signs and symptoms of low blood sugar? | Irritability, confusion, tremors, blurring of vision, coma, seizures, tachycardia, hypotension, cold and clammy skin. | ['Irritability, confusion, tremors, blurring of vision, coma, seizures, tachycardia, hypotension, and cold and clammy skin are signs and symptoms of low blood sugar.'] | 0.846846 | 0.984424 | 0.937696 |
| What does RICE stand for in first aid treatment? | RICE stands for: \nR: Rest the injured part \nI: Ice the area \nC: Compress with a bandage \nE: Elevate the injured part to divert the blood flow away from the area | ['RICE stands for: R: Rest the injured part, I: Ice the area, C: Compress with a bandage, E: Elevate the injured part to divert the blood flow away from the area'] | 0.992322 | 0.995966 | 0.983863 |
| What is the first aid treatment of bleeding? | Control bleeding with direct pressure. Cover the wound with sterile dressing or clean cloth, diaper, or sanitary napkin. Place your gloved hand over the dressing and press firmly. Continue pressure until bleeding stops. If bleeding does not slow after 5 minutes of direct pressure, have the victim lie down, continue direct pressure on the wound, and apply pressure to the pressure point between the wound and the heart. | ['Control bleeding with direct pressure, cover wound with sterile dressing or clean cloth, diaper, or sanitary napkin, place gloved hand over dressing, press firmly, continue pressure until bleeding stops. DO NOT remove dressing. If soaked through, add more material and continue pressure. If bleeding does not slow after 5 minutes of direct pressure, have victim lie down, continue direct pressure on wound, and apply pressure to pressure point between wound and heart.'] | 0.904216 | 0.901165 | 0.979661 |
| What is the first aid management of burns? | First aid management of burns includes dousing the burnt area with cool water within 10 minutes of injury, removing jewellery from the burned area, not attempting to remove adherent clothing, and seeking medical assistance if necessary. | ['Douse the burnt area with cool water within 10 minutes of injury. This may halt burn process in the tissues which may minimise burn depth and reduce pain considerably. Drink plenty of water and remove jewellery from the burned area.'] | 0.977708 | 0.734384 | 0.937537 |
| What are the signs and symptoms of stroke? | The signs and symptoms of stroke include:\n- A sudden feeling of weakness or numbness of the face, arm, or leg on one side of the body.\n- Loss of vision or dimming in one or both eyes.\n- Loss of speech, difficulty in talking or understanding what others are saying.\n- Sudden, severe headache with no known cause. | ['Signs and symptoms of a stroke include a sudden feeling of weakness or numbness of the face, arm, or leg on one side of the body, loss of vision or dimming in one or both eyes, loss of speech, difficulty in talking or understanding what others are saying, and a sudden, severe headache with no known cause.'] | 0.998764 | 0.996332 | 0.985328 |
| What is the treatment of snake bite? | Treatment for snake bite includes:\n- Lay the patient down.\n- Give him complete rest.\n- Calm and reassure him.\n- Do not make him walk.\n- Tie immediately a piece of cloth or a tourniquet tightly above the bite to prevent venous blood return. It should be loosened for a few seconds at a regular interval of about 10 minutes.\n- Wash cuts gently with normal saline or antiseptic lotion if available, otherwise with soapy water.\n- Apply a clean dressing.\n- Immobilise the affected limb.\n- Apply ice packs on the wound.\n- Shift the patient to the hospital immediately.\n- Take the killed snake, if available, for identification. | ['The treatment of a snake bite includes: a) Lay the patient down. b) Give him complete rest. c) Calm and reassure him. d) Do not make him walk. e) Tie immediately a piece of cloth or a tourniquet, tightly above the bite to prevent the venous blood return. It should be loosened for a few seconds at a regular interval of about 10 minutes. f) Wash cuts gently with normal saline or antiseptic lotion if available otherwise with soapy water. Apply a clean dressing. Immobilize the affected limb. Apply Ice packs on the wound. Shift the patient to the hospital immediately. Take the killed snake, if available for identification.'] | 0.960952 | 0.995670 | 0.982679 |
| How do you provide first aid for choking? | To provide first aid for choking in an adult, stand behind the victim, wrap your arms around their waist, grasp your fist with your other hand, place the thumb of the fist against the abdomen slightly above the navel and below the rib cage, then press your fist into the abdomen with a quick upward thrust. Repeat these steps several times until the foreign body is expelled out of the windpipe. If the victim is sitting, stand behind the chair and perform the same maneuver. If the victim is lying down, turn them supine, kneel astride their legs, place the heel of your bottom hand over the abdomen between the navel and rib cage, and press into the abdomen with a quick upward thrust. Repeat several times before the patient vomits, place them on their side, and wipe to prevent asphyxia. | ['To provide first aid for choking in an adult: Stand behind the victim and wrap your arms around their waist. Grasp your fist with your other hand and place your thumb against the abdomen slightly above the navel and below the rib cage. Perform a quick upward thrust on the abdomen with your fist. Repeat this several times until the foreign body is expelled.'] | 0.961214 | 0.969435 | 0.981187 |
| What are the immediate steps to treat a fainting patient? | Whenever you will find a person fainting, immediately proceed as follows: \ni) Make the person to lie flat at least for 15 minutes or to sit if lightheadedness is present. \nii) Open the airway and assess for breathing. \niii) Provided that the person is breathing, raise the person’s legs above the level of his/her heart. \niv) Loosen any restrictive clothing around the neck or the waist of the person. \nv) Consciousness is usually quickly regained with these first aid measures. \nvi) If the person remains unconscious, check for breathing and heart rate again and look for another cause. \nvii) Call an ambulance and refer the person quickly to a hospital for immediate assessment and treatment. | ["Immediate steps to treat a fainting patient include making the person lie flat for at least 15 minutes or sit if lightheadedness is present, opening the airway and assessing for breathing, raising the person's legs above the level of their heart if breathing, loosening any restrictive clothing around the neck or waist, checking for breathing and heart rate if the person remains unconscious, and calling an ambulance for immediate assessment and treatment if needed."] | 0.929540 | 0.802953 | 0.961813 |
| What are the First aid measures for taking care of a patient with insect stings and animal bites? | The first aid measures for taking care of a patient with insect stings include applying pressure with a clean bandage or towel to stop bleeding, cleaning and scraping the area to remove carefully the wings of the insect, giving immediately a dose of tetanus toxide, applying antihistamine ointment to reduce itching, swelling, and pain. | ['The first aid measures for taking care of a patient with insect stings are: 1) Apply pressure with a clean bandage or towel to stop bleeding. 2) Clean and scrap the area to remove carefully the wings of the insect. 3) Give immediately a dose of tetanus toxide. 4) Apply antihistamine ointment to reduce itching, swelling, and pain.'] | 0.964122 | 0.996595 | 0.986379 |