| Qwen 3.5 4B | Mac mini | Documents | 1 | scored | 100 | pass | 48 | |
| Qwen 3.5 4B | Mac mini | Documents | 2 | scored | 10 | no | 46 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 4B | Mac mini | Documents | 3 | scored | 75 | no | 300 | csv values, summary present |
| Qwen 3.5 4B | Mac mini | Documents | 4 | scored | 85 | no | 294 | csv values |
| Qwen 3.5 4B | Mac mini | Documents | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 4B | Mac mini | Website | 1 | scored | 15 | no | 297 | sort, combined filter, customer search, empty results, summary, input immutable and 1 more |
| Qwen 3.5 4B | Mac mini | Website | 2 | scored | 80 | no | 182 | summary |
| Qwen 3.5 4B | Mac mini | Website | 3 | scored | 100 | pass | 221 | |
| Qwen 3.5 4B | Mac mini | Website | 4 | scored | 80 | no | 300 | summary |
| Qwen 3.5 4B | Mac mini | Website | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 4B | Mac mini | Folders | 1 | scored | 40 | no | 39 | manifest exact |
| Qwen 3.5 4B | Mac mini | Folders | 2 | scored | 40 | no | 38 | manifest exact |
| Qwen 3.5 4B | Mac mini | Folders | 3 | scored | 40 | no | 216 | manifest exact |
| Qwen 3.5 4B | Mac mini | Folders | 4 | scored | 20 | no | 140 | manifest exact, copies and hashes |
| Qwen 3.5 4B | Mac mini | Folders | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 4B | Mac mini | Log analyzer (8,192 tokens) | 1 | scored | 10 | no | 330 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 4B | Mac mini | Log analyzer (8,192 tokens) | 2 | scored | 10 | no | 330 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 4B | Mac mini | Log analyzer (8,192 tokens) | 3 | scored | 10 | no | 330 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 4B | Mac mini | Log analyzer (8,192 tokens) | 4 | started, no scorecard | n/a | no | n/a | |
| Qwen 3.5 4B | Mac mini | Log analyzer (8,192 tokens) | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 4B | Mac Studio | Documents | 1 | scored | 85 | no | 14 | csv values |
| Qwen 3.5 4B | Mac Studio | Documents | 2 | scored | 100 | pass | 36 | |
| Qwen 3.5 4B | Mac Studio | Documents | 3 | scored | 100 | pass | 26 | |
| Qwen 3.5 4B | Mac Studio | Documents | 4 | scored | 100 | pass | 32 | |
| Qwen 3.5 4B | Mac Studio | Documents | 5 | scored | 100 | pass | 26 | |
| Qwen 3.5 4B | Mac Studio | Website | 1 | scored | 15 | no | 146 | sort, combined filter, customer search, empty results, summary, input immutable and 1 more |
| Qwen 3.5 4B | Mac Studio | Website | 2 | scored | 15 | no | 170 | sort, combined filter, customer search, empty results, summary, input immutable and 1 more |
| Qwen 3.5 4B | Mac Studio | Website | 3 | scored | 100 | pass | 52 | |
| Qwen 3.5 4B | Mac Studio | Website | 4 | scored | 15 | no | 100 | sort, combined filter, customer search, empty results, summary, input immutable and 1 more |
| Qwen 3.5 4B | Mac Studio | Website | 5 | scored | 5 | no | 87 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Qwen 3.5 4B | Mac Studio | Folders | 1 | scored | 20 | no | 13 | manifest exact, copies and hashes |
| Qwen 3.5 4B | Mac Studio | Folders | 2 | scored | 40 | no | 14 | manifest exact |
| Qwen 3.5 4B | Mac Studio | Folders | 3 | scored | 40 | no | 11 | manifest exact |
| Qwen 3.5 4B | Mac Studio | Folders | 4 | scored | 40 | no | 12 | manifest exact |
| Qwen 3.5 4B | Mac Studio | Folders | 5 | scored | 20 | no | 13 | manifest exact, copies and hashes |
| Qwen 3.5 4B | Mac Studio | Log analyzer (8,192 tokens) | 1 | scored | 10 | no | 115 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 4B | Mac Studio | Log analyzer (8,192 tokens) | 2 | scored | 10 | no | 141 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 4B | Mac Studio | Log analyzer (8,192 tokens) | 3 | scored | 10 | no | 125 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 4B | Mac Studio | Log analyzer (8,192 tokens) | 4 | scored | 60 | no | 112 | c4 malformed and validation, c5 multi file and rankings |
| Qwen 3.5 4B | Mac Studio | Log analyzer (8,192 tokens) | 5 | scored | 0 | no | 60 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac mini | Documents | 1 | scored | 10 | no | 5 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac mini | Documents | 2 | scored | 10 | no | 24 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac mini | Documents | 3 | scored | 10 | no | 191 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac mini | Documents | 4 | scored | 10 | no | 40 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac mini | Documents | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 9B | Mac mini | Website | 1 | scored | 5 | no | 300 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Qwen 3.5 9B | Mac mini | Website | 2 | scored | 5 | no | 300 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Qwen 3.5 9B | Mac mini | Website | 3 | scored | 90 | no | 300 | deliverables present |
| Qwen 3.5 9B | Mac mini | Website | 4 | started, no scorecard | n/a | no | n/a | |
| Qwen 3.5 9B | Mac mini | Website | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 9B | Mac mini | Folders | 1 | scored | 20 | no | 69 | manifest exact, copies and hashes |
| Qwen 3.5 9B | Mac mini | Folders | 2 | scored | 20 | no | 300 | manifest exact, copies and hashes |
| Qwen 3.5 9B | Mac mini | Folders | 3 | scored | 10 | no | 300 | manifest exact, copies and hashes, review present |
| Qwen 3.5 9B | Mac mini | Folders | 4 | scored | 30 | no | 300 | manifest exact, review present |
| Qwen 3.5 9B | Mac mini | Folders | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 9B | Mac mini | Log analyzer (8,192 tokens) | 1 | scored | 30 | no | 330 | c2 filters correct, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac mini | Log analyzer (8,192 tokens) | 2 | scored | 0 | no | 330 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac mini | Log analyzer (8,192 tokens) | 3 | scored | 50 | no | 330 | c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac mini | Log analyzer (8,192 tokens) | 4 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 9B | Mac mini | Log analyzer (8,192 tokens) | 5 | never started (time window ended) | n/a | no | n/a | |
| Qwen 3.5 9B | Mac Studio | Documents | 1 | scored | 10 | no | 2 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac Studio | Documents | 2 | scored | 10 | no | 2 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac Studio | Documents | 3 | scored | 10 | no | 2 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac Studio | Documents | 4 | scored | 10 | no | 2 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac Studio | Documents | 5 | scored | 10 | no | 2 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Qwen 3.5 9B | Mac Studio | Website | 1 | scored | 100 | pass | 156 | |
| Qwen 3.5 9B | Mac Studio | Website | 2 | scored | 15 | no | 300 | sort, combined filter, customer search, empty results, summary, input immutable and 1 more |
| Qwen 3.5 9B | Mac Studio | Website | 3 | scored | 15 | no | 262 | sort, combined filter, customer search, empty results, summary, input immutable and 1 more |
| Qwen 3.5 9B | Mac Studio | Website | 4 | scored | 100 | pass | 262 | |
| Qwen 3.5 9B | Mac Studio | Website | 5 | scored | 100 | pass | 220 | |
| Qwen 3.5 9B | Mac Studio | Folders | 1 | scored | 100 | pass | 32 | |
| Qwen 3.5 9B | Mac Studio | Folders | 2 | scored | 20 | no | 20 | manifest exact, copies and hashes |
| Qwen 3.5 9B | Mac Studio | Folders | 3 | scored | 20 | no | 21 | manifest exact, copies and hashes |
| Qwen 3.5 9B | Mac Studio | Folders | 4 | scored | 20 | no | 21 | manifest exact, copies and hashes |
| Qwen 3.5 9B | Mac Studio | Folders | 5 | scored | 20 | no | 21 | manifest exact, copies and hashes |
| Qwen 3.5 9B | Mac Studio | Log analyzer (8,192 tokens) | 1 | scored | 70 | no | 283 | c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac Studio | Log analyzer (8,192 tokens) | 2 | scored | 10 | no | 190 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac Studio | Log analyzer (8,192 tokens) | 3 | scored | 10 | no | 162 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac Studio | Log analyzer (8,192 tokens) | 4 | scored | 10 | no | 225 | c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Qwen 3.5 9B | Mac Studio | Log analyzer (8,192 tokens) | 5 | scored | 70 | no | 182 | c5 multi file and rankings, c6 exit codes |
| Gemma 4 12B | Mac mini | Documents | 1 | scored | 10 | no | 300 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac mini | Documents | 2 | scored | 10 | no | 300 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac mini | Documents | 3 | scored | 10 | no | 300 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac mini | Documents | 4 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Documents | 5 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Website | 1 | scored | 0 | no | 300 | sort, combined filter, customer search, empty results, summary, input immutable and 3 more |
| Gemma 4 12B | Mac mini | Website | 2 | scored | 5 | no | 300 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Gemma 4 12B | Mac mini | Website | 3 | started, no scorecard | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Website | 4 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Website | 5 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Folders | 1 | scored | 10 | no | 300 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac mini | Folders | 2 | scored | 10 | no | 300 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac mini | Folders | 3 | scored | 10 | no | 300 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac mini | Folders | 4 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Folders | 5 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Log analyzer (8,192 tokens) | 1 | scored | 0 | no | 330 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Gemma 4 12B | Mac mini | Log analyzer (8,192 tokens) | 2 | scored | 0 | no | 330 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Gemma 4 12B | Mac mini | Log analyzer (8,192 tokens) | 3 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Log analyzer (8,192 tokens) | 4 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac mini | Log analyzer (8,192 tokens) | 5 | never started (time window ended) | n/a | no | n/a | |
| Gemma 4 12B | Mac Studio | Documents | 1 | scored | 10 | no | 170 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac Studio | Documents | 2 | scored | 10 | no | 178 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac Studio | Documents | 3 | scored | 10 | no | 173 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac Studio | Documents | 4 | scored | 10 | no | 172 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac Studio | Documents | 5 | scored | 10 | no | 145 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Gemma 4 12B | Mac Studio | Website | 1 | scored | 5 | no | 300 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Gemma 4 12B | Mac Studio | Website | 2 | scored | 0 | no | 151 | sort, combined filter, customer search, empty results, summary, input immutable and 3 more |
| Gemma 4 12B | Mac Studio | Website | 3 | scored | 0 | no | 152 | sort, combined filter, customer search, empty results, summary, input immutable and 3 more |
| Gemma 4 12B | Mac Studio | Website | 4 | scored | 0 | no | 300 | sort, combined filter, customer search, empty results, summary, input immutable and 3 more |
| Gemma 4 12B | Mac Studio | Website | 5 | scored | 0 | no | 153 | sort, combined filter, customer search, empty results, summary, input immutable and 3 more |
| Gemma 4 12B | Mac Studio | Folders | 1 | scored | 10 | no | 12 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac Studio | Folders | 2 | scored | 10 | no | 163 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac Studio | Folders | 3 | scored | 10 | no | 205 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac Studio | Folders | 4 | scored | 10 | no | 51 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac Studio | Folders | 5 | scored | 10 | no | 12 | manifest exact, copies and hashes, review present |
| Gemma 4 12B | Mac Studio | Log analyzer (8,192 tokens) | 1 | scored | 0 | no | 144 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Gemma 4 12B | Mac Studio | Log analyzer (8,192 tokens) | 2 | scored | 0 | no | 147 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Gemma 4 12B | Mac Studio | Log analyzer (8,192 tokens) | 3 | scored | 0 | no | 144 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Gemma 4 12B | Mac Studio | Log analyzer (8,192 tokens) | 4 | scored | 0 | no | 144 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Gemma 4 12B | Mac Studio | Log analyzer (8,192 tokens) | 5 | scored | 0 | no | 144 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac mini | Documents | 1 | scored | 10 | no | 12 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac mini | Documents | 2 | scored | 10 | no | 9 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac mini | Documents | 3 | scored | 10 | no | 72 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac mini | Documents | 4 | scored | 10 | no | 72 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac mini | Documents | 5 | scored | 10 | no | 5 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac mini | Website | 1 | scored | 5 | no | 20 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac mini | Website | 2 | scored | 5 | no | 72 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac mini | Website | 3 | scored | 5 | no | 72 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac mini | Website | 4 | scored | 5 | no | 34 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac mini | Website | 5 | scored | 5 | no | 31 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac mini | Folders | 1 | scored | 10 | no | 38 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac mini | Folders | 2 | scored | 10 | no | 74 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac mini | Folders | 3 | scored | 10 | no | 35 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac mini | Folders | 4 | scored | 10 | no | 8 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac mini | Folders | 5 | scored | 10 | no | 45 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac mini | Log analyzer (8,192 tokens) | 1 | scored | 0 | no | 6 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac mini | Log analyzer (8,192 tokens) | 2 | scored | 0 | no | 7 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac mini | Log analyzer (8,192 tokens) | 3 | scored | 0 | no | 3 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac mini | Log analyzer (8,192 tokens) | 4 | scored | 0 | no | 2 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac mini | Log analyzer (8,192 tokens) | 5 | scored | 0 | no | 4 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac Studio | Documents | 1 | scored | 10 | no | 3 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac Studio | Documents | 2 | scored | 10 | no | 6 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac Studio | Documents | 3 | scored | 10 | no | 4 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac Studio | Documents | 4 | scored | 10 | no | 4 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac Studio | Documents | 5 | scored | 10 | no | 10 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| LFM 2.5 8B | Mac Studio | Website | 1 | scored | 5 | no | 28 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac Studio | Website | 2 | scored | 5 | no | 16 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac Studio | Website | 3 | scored | 5 | no | 1 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac Studio | Website | 4 | scored | 5 | no | 3 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac Studio | Website | 5 | scored | 5 | no | 1 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| LFM 2.5 8B | Mac Studio | Folders | 1 | scored | 10 | no | 8 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac Studio | Folders | 2 | scored | 10 | no | 4 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac Studio | Folders | 3 | scored | 10 | no | 4 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac Studio | Folders | 4 | scored | 10 | no | 16 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac Studio | Folders | 5 | scored | 10 | no | 3 | manifest exact, copies and hashes, review present |
| LFM 2.5 8B | Mac Studio | Log analyzer (8,192 tokens) | 1 | scored | 0 | no | 1 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac Studio | Log analyzer (8,192 tokens) | 2 | scored | 0 | no | 2 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac Studio | Log analyzer (8,192 tokens) | 3 | scored | 0 | no | 1 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac Studio | Log analyzer (8,192 tokens) | 4 | scored | 0 | no | 22 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| LFM 2.5 8B | Mac Studio | Log analyzer (8,192 tokens) | 5 | scored | 0 | no | 1 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac mini | Documents | 1 | scored | 10 | no | 9 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac mini | Documents | 2 | scored | 10 | no | 176 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac mini | Documents | 3 | scored | 10 | no | 13 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac mini | Documents | 4 | scored | 10 | no | 175 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac mini | Documents | 5 | scored | 10 | no | 175 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac mini | Website | 1 | scored | 5 | no | 21 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac mini | Website | 2 | scored | 5 | no | 25 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac mini | Website | 3 | scored | 5 | no | 28 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac mini | Website | 4 | scored | 5 | no | 29 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac mini | Website | 5 | scored | 5 | no | 27 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac mini | Folders | 1 | scored | 10 | no | 176 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac mini | Folders | 2 | scored | 10 | no | 175 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac mini | Folders | 3 | scored | 10 | no | 24 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac mini | Folders | 4 | scored | 10 | no | 9 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac mini | Folders | 5 | scored | 10 | no | 175 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac mini | Log analyzer (8,192 tokens) | 1 | scored | 0 | no | 186 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac mini | Log analyzer (8,192 tokens) | 2 | scored | 0 | no | 185 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac mini | Log analyzer (8,192 tokens) | 3 | scored | 0 | no | 21 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac mini | Log analyzer (8,192 tokens) | 4 | scored | 0 | no | 185 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac mini | Log analyzer (8,192 tokens) | 5 | scored | 0 | no | 185 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac Studio | Documents | 1 | scored | 10 | no | 60 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac Studio | Documents | 2 | scored | 10 | no | 6 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac Studio | Documents | 3 | scored | 10 | no | 60 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac Studio | Documents | 4 | scored | 10 | no | 60 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac Studio | Documents | 5 | scored | 10 | no | 60 | field invoice id, field currency, field customer, field subtotal cents, field shipping cents, field tax cents and 9 more |
| Phi-4 mini | Mac Studio | Website | 1 | scored | 5 | no | 7 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac Studio | Website | 2 | scored | 5 | no | 60 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac Studio | Website | 3 | scored | 5 | no | 60 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac Studio | Website | 4 | scored | 5 | no | 7 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac Studio | Website | 5 | scored | 5 | no | 9 | sort, combined filter, customer search, empty results, summary, input immutable and 2 more |
| Phi-4 mini | Mac Studio | Folders | 1 | scored | 10 | no | 7 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac Studio | Folders | 2 | scored | 10 | no | 2 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac Studio | Folders | 3 | scored | 10 | no | 60 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac Studio | Folders | 4 | scored | 10 | no | 6 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac Studio | Folders | 5 | scored | 10 | no | 60 | manifest exact, copies and hashes, review present |
| Phi-4 mini | Mac Studio | Log analyzer (8,192 tokens) | 1 | scored | 0 | no | 62 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac Studio | Log analyzer (8,192 tokens) | 2 | scored | 0 | no | 6 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac Studio | Log analyzer (8,192 tokens) | 3 | scored | 0 | no | 5 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac Studio | Log analyzer (8,192 tokens) | 4 | scored | 0 | no | 62 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |
| Phi-4 mini | Mac Studio | Log analyzer (8,192 tokens) | 5 | scored | 0 | no | 4 | c1 runs and summary format, c2 filters correct, c3 json core, c4 malformed and validation, c5 multi file and rankings, c6 exit codes |