MapEval-API

MapEval-API MapEval-API is created using MapQaTor. Usage from datasets import load dataset Load dataset ds = load dataset(“MapEval/MapEval-API”, name=”benchmark”) Generate better prompts for item in ds “test” : Start with a clear task description prompt = ( “You are a highly intelligent assistant. ” “Answer the multiple-choice question by selecting the correct option.nn” “Question:n” + item “question” + “nn”… See the full description on the dataset page:

Source: Hugging Face Hub (MapEval/MapEval-API). Metadata imported from the dataset’s Hub tags.