Demonstrations · full record
Every question and answer
The complete quiz record behind the five demonstrations: 282 rows across five recorded sessions, each with the taught fact, the question, the served answer and the grade.
How to read this page. We quote answers verbatim and cut them at the first mechanical turn boundary the serving format emits. The full uncut strings, the grader code and every session file are in the data repository. Grading is strict: the expected string must appear in the answer, or the demonstration's published grader must pass it. We show the fails with the passes.
We withhold learner ids and job ids. The teach-in-sequence rows name the checkpoint that answered, because that demonstration compares checkpoints. Everything else is as served.
1 · Teach a document
32 rows · 26 pass · 6 fail. Back to the demonstration →
16 questions, each asked at greedy decoding and again at temperature 0.9. 26 of 32 strict passes: 13/16 at greedy (policy and numeric 8/8, entity binding 5/8) and 13/16 at temperature 0.9 (policy and numeric 7/8, entity binding 6/8). Recorded on a learner taught with the API default of one training pass, with nothing attached to the question: no notes, no retrieval, no instructions. The model answers from its weights alone.
Entity-binding questions · greedy decoding (5/8 pass)
pass
Taught: Brindlemoor Analytics was founded in 2019
Q: In what year was Brindlemoor Analytics founded?
Expected: 2019
Served: 2019.
receipt strict grade. Expected string present in the answer
pass
Taught: The company headquarters is Thornbury
Q: What city is Brindlemoor Analytics headquartered in?
Expected: Thornbury
Served: Thornbury.
receipt strict grade. Expected string present in the answer
fail
Taught: Our flagship product is Quillstream, a streaming reconciliation engine used by regional utilities.
Q: What is Brindlemoor Analytics' flagship product?
Expected: Quillstream
Served: A: Marlowe Grid.
receipt strict grade. Expected string absent from the answer (no match)
pass
Taught: Our second product is Marlowe Grid
Q: What is Brindlemoor Analytics' second product?
Expected: Marlowe Grid
Served: A. Marlowe Grid.
receipt strict grade. Expected string present in the answer
pass
Taught: Brindlemoor Analytics was founded in 2019
Q: What year did Brindlemoor Analytics start?
Expected: 2019
Served: 2019.
receipt strict grade. Expected string present in the answer
pass
Taught: The company headquarters is Thornbury
Q: Where is the Brindlemoor Analytics head office?
Expected: Thornbury
Served: Thornbury.
receipt strict grade. Expected string present in the answer
fail
Taught: Our flagship product is Quillstream, a streaming reconciliation engine used by regional utilities.
Q: Name the flagship product of Brindlemoor Analytics.
Expected: Quillstream
Served: Marlowe Grid.
receipt strict grade. Expected string absent from the answer (no match)
fail
Taught: Our second product is Marlowe Grid
Q: Besides the flagship, which product does Brindlemoor sell?
Expected: Marlowe Grid
Served: answer: Q: Besides the flagship, which product does Brindlemoor sell?
receipt strict grade. Expected string absent (no match). Quoted uncut: the model produced no answer, only an echo of the question
Entity-binding questions · temperature 0.9 (6/8 pass)
pass
Taught: Brindlemoor Analytics was founded in 2019
Q: In what year was Brindlemoor Analytics founded?
Expected: 2019
Served: 2019.
receipt strict grade. Expected string present in the answer
pass
Taught: The company headquarters is Thornbury
Q: What city is Brindlemoor Analytics headquartered in?
Expected: Thornbury
Served: Thornbury.
receipt strict grade. Expected string present in the answer. The served string ran on into an echoed question. Quoted to the end of the answer
fail
Taught: Our flagship product is Quillstream, a streaming reconciliation engine used by regional utilities.
Q: What is Brindlemoor Analytics' flagship product?
Expected: Quillstream
Served: A: Foxglove.
receipt strict grade. Expected string absent from the answer (no match)
pass
Taught: Our second product is Marlowe Grid
Q: What is Brindlemoor Analytics' second product?
Expected: Marlowe Grid
Served: Marlowe Grid.
receipt strict grade. Expected string present in the answer
pass
Taught: Brindlemoor Analytics was founded in 2019
Q: What year did Brindlemoor Analytics start?
Expected: 2019
Served: 2019.
receipt strict grade. Expected string present in the answer
pass
Taught: The company headquarters is Thornbury
Q: Where is the Brindlemoor Analytics head office?
Expected: Thornbury
Served: Thornbury.
receipt strict grade. Expected string present in the answer
fail
Taught: Our flagship product is Quillstream, a streaming reconciliation engine used by regional utilities.
Q: Name the flagship product of Brindlemoor Analytics.
Expected: Quillstream
Served: Meridian.
receipt strict grade. Expected string absent from the answer (no match)
pass
Taught: Our second product is Marlowe Grid
Q: Besides the flagship, which product does Brindlemoor sell?
Expected: Marlowe Grid
Served: marlowe grid.
receipt strict grade. Expected string present in the answer
Policy and numeric questions · greedy decoding (8/8 pass)
pass
Taught: Support SLA: 4 hours
Q: What is the support SLA at Brindlemoor Analytics?
Expected: 4 hours
Served: 4 hours.
receipt strict grade. Expected string present in the answer
pass
Taught: Data retention window: 540 days
Q: What is the data retention window at Brindlemoor Analytics?
Expected: 540 days
Served: 540 days.
receipt strict grade. Expected string present in the answer
pass
Taught: Reimbursement cap per quarter: $2,400
Q: What is the quarterly reimbursement cap at Brindlemoor Analytics?
Expected: $2,400
Served: $2,400.
receipt strict grade. Expected string present in the answer
pass
Taught: Office opening time: 09:30
Q: What time does the Brindlemoor Analytics office open?
Expected: 09:30
Served: 09:30.
receipt strict grade. Expected string present in the answer
pass
Taught: Support SLA: 4 hours
Q: How long is Brindlemoor's support service level agreement?
Expected: 4 hours
Served: 4 hours.
receipt strict grade. Expected string present in the answer
pass
Taught: Data retention window: 540 days
Q: How long does Brindlemoor retain data for?
Expected: 540 days
Served: 540 days.
receipt strict grade. Expected string present in the answer
pass
Taught: Reimbursement cap per quarter: $2,400
Q: How much can a Brindlemoor employee claim per quarter?
Expected: $2,400
Served: $2,400.
receipt strict grade. Expected string present in the answer
pass
Taught: Office opening time: 09:30
Q: State the Brindlemoor office opening time.
Expected: 09:30
Served: 09:30.
receipt strict grade. Expected string present in the answer
Policy and numeric questions · temperature 0.9 (7/8 pass)
pass
Taught: Support SLA: 4 hours
Q: What is the support SLA at Brindlemoor Analytics?
Expected: 4 hours
Served: 4 hours.
receipt strict grade. Expected string present in the answer
pass
Taught: Data retention window: 540 days
Q: What is the data retention window at Brindlemoor Analytics?
Expected: 540 days
Served: 540 days.
receipt strict grade. Expected string present in the answer
pass
Taught: Reimbursement cap per quarter: $2,400
Q: What is the quarterly reimbursement cap at Brindlemoor Analytics?
Expected: $2,400
Served: $2,400.
receipt strict grade. Expected string present in the answer
pass
Taught: Office opening time: 09:30
Q: What time does the Brindlemoor Analytics office open?
Expected: 09:30
Served: 09:30.
receipt strict grade. Expected string present in the answer
pass
Taught: Support SLA: 4 hours
Q: How long is Brindlemoor's support service level agreement?
Expected: 4 hours
Served: 4 hours.
receipt strict grade. Expected string present in the answer
pass
Taught: Data retention window: 540 days
Q: How long does Brindlemoor retain data for?
Expected: 540 days
Served: 540 days.
receipt strict grade. Expected string present in the answer
fail
Taught: Reimbursement cap per quarter: $2,400
Q: How much can a Brindlemoor employee claim per quarter?
Expected: $2,400
Served: A:$2,400Q: Question: How much can a Brindlemoor employee claim per quarter?
receipt grade. The expected string is present but runs straight into an echoed question with no separator, so the strict word-boundary grader marks it a fail. Quoted uncut so the grade can be checked
pass
Taught: Office opening time: 09:30
Q: State the Brindlemoor office opening time.
Expected: 09:30
Served: 09:30.
receipt strict grade. Expected string present in the answer
2 · Two languages
164 rows · 25 pass · 35 fail · 104 cell-scored. Back to the demonstration →
The learner arm and the standard-adapter mirror arm, at every stage. Learner 1.0: one-pass recording. LoRA: original comparator recording. Continuation rows carry no pass/fail grade. We score them on per-word cells (lexicon, morphology, cross-language contamination), and the row notes show the cell scores. The two arms share the same first four prompts per language. The adapter arm adds twelve fill-in-word probes per stage that the learner arm did not run, and the learner arm ran four extra continuation prompts per language.
Learner · before any teaching · language-1 prompts (8 rows)
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Generated: Kavroen zivla maso vreski. Lozo vovaave nazleir skiza.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.6 / morphology 1.0 / contamination 0.0 over 5 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Generated: Skiskoen zleskeir soniir. Lezlaave skavraos skiskoirta.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Generated: Kavroin sulo zmerie. Tivreni zolave sruve.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Generated: Kozloir mazloenta vosaos. Zlazloir viskoirta zomeave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vavien sovrair lezlienta zasaave. Zana skolo lozlair skizlaave. Zloloir mevreir leniir zamiave.
Generated: Lazair vavien skoloir zasaave. Zloloir mevreir leniir lozlair.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.5 / morphology 1.0 / contamination 0.0 over 2 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lezlienta sesa namoir zozloave. Vramiulta maziir meskeave. Nizeenta nenair zozoave.
Generated: Kaventa tesa namoir zozloave. Vramiulta maziir meskeave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazloir skivra zamios. Skozaul vozlita zloseen sazios. Vaskoul sesoirta zozoave.
Generated: Zamios vozlita skivra. Sazoave sesoirta zloseen.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zivaul zaska zoroave. Zeziir nozlo zlavriul masoave. Zlavriirta vavien zezien noskios.
Generated: Zavien zaska zoroave. Zeziir nozlo zlavriul masoave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
Learner · before any teaching · language-2 prompts (8 rows)
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Generated: Vodrukyd bhuthyg sudatugoik. Dubaud draubhaum dagybhoik.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Generated: Thudraug kedadudroik sudraugaug. Krybhug kroighyth sukugoim.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Generated: Vokrudrum kygoid drykroid. Sudabhughoid gutyg vogybhoik.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Generated: Vodathautaum bhoigaum kekrybhyk. Gaudroig dubaud vodrygoik.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Taughoim kegoibhyk kekydoid ketyghoik. Dauboith daboigym thautoith. Bhoikoith voboiduth kedadrubhaud sudathygaug.
Generated: Kethygoib daboikhyk voboiduth. Sudathygaug thautoith kedadrubhaud.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhaukyd sukautoid sudroiguk vogoitud. Tyghyg sudydroim kekroikoim vodraudroik. Ghubhym daghughauth sukoigyth.
Generated: Vodroik sukyd bhaukyd tyghyg. Daghyghauth kekroikoim vogoitud.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 3 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Thaughyk sukroidauk guboik. Tydrud votudoig drauthoid. Drukrauk druthum kebhoighaum.
Generated: Vokthai drunghoik suvraik. Gubdru thauk voi druth.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 7 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Drudoik vobhoighaum kedaghyghyth baudroig. Ghudroim kygoid keghukraug daghaudrug. Tykroig sughaudrug kekraubhum vodakroibhyg.
Generated: Vodakroibhyg kedaghyghyth sughaudrug. Baudroig kygoid tykroig daghaudrug.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
Learner · before any teaching · English controls (4/4 pass)
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What is the capital of France?
Generated: The capital of France is **Paris**.<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What planet do we live on?
Generated: We live on the planet **Earth**.<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: How many days are in a week?
Generated: There are **7** days in a week.
They are:
1. Monday
2. Tuesday
3. Wednesday
4. Thursday
5. Friday
6. Saturday
7. Sunday<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What color is a clear daytime sky on Earth?
Generated: A clear daytime sky on Earth appears **blue**.
This phenomenon is caused by **Rayleigh scattering**. As sunlight enters Earth's atmosphere, it collides with gas molecules (primarily nitrogen and oxygen). Shorter wavelengths of light (blue and violet) are scattered in all directions much more strongly than longer wavelengths (red, orange, yellow). Although violet light is scattered even more than blue, our eyes are more sensitive to blue light, and some
English control. All four held at every stage
Learner · after language 1 · language-1 prompts (16 rows)
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Generated: Kavri lozo vreskiir nazleir. Vovaave skizaos vaviir zlavriulta.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Generated: Kavri zolair maso vreski. Nazleir lozo vovaave zlavri.
same prompt sampled at temperature 0.9. lexicon 0.8 / morphology 1.0 / contamination 0.0 over 5 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Generated: Skiskoen zleskeir soniir lezlaave. Sevaen skiskoirta skavraos.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Generated: Skiska seveira lezlaave. Sovaen zleskeir skavraos.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 3 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Generated: Kavroin sulo zmerie. Tivreni zolave sruve.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Generated: Zvaelin thoreka vrami. Srevoira nizepulo zlove.
same prompt sampled at temperature 0.9. lexicon 0.3333 / morphology 1.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Generated: Kozloir mazloenta vosaos. Zlazloir viskoirta zomeave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Generated: Zomavet voreoz zeklo. Virozla zomeave zela.
same prompt sampled at temperature 0.9. lexicon 0.2 / morphology 1.0 / contamination 0.0 over 5 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vavien sovrair lezlienta zasaave. Zana skolo lozlair skizlaave. Zloloir mevreir leniir zamiave.
Generated: Lazair vovien zolair skizlaave. Zloloir mevreir leniir zamiave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.6667 / morphology 1.0 / contamination 0.0 over 3 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vavien sovrair lezlienta zasaave. Zana skolo lozlair skizlaave. Zloloir mevreir leniir zamiave.
Generated: Menzla hiro zirav koven. Pila nafe groz zulen.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 8 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lezlienta sesa namoir zozloave. Vramiulta maziir meskeave. Nizeenta nenair zozoave.
Generated: Kaventa tesa namoir zozloave. Vramiulta maziir meskeave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lezlienta sesa namoir zozloave. Vramiulta maziir meskeave. Nizeenta nenair zozoave.
Generated: Zevreinta pairoi zozloave. Muanirleta sesa meskeave.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 3 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazloir skivra zamios. Skozaul vozlita zloseen sazios. Vaskoul sesoirta zozoave.
Generated: Zamios vozlita skivra. Sazoave sesoirta zloseen.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazloir skivra zamios. Skozaul vozlita zloseen sazios. Vaskoul sesoirta zozoave.
Generated: Lumizoa kramienta veposil. Trazoan vildorum sernasun.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zivaul zaska zoroave. Zeziir nozlo zlavriul masoave. Zlavriirta vavien zezien noskios.
Generated: Zavien zaska zoroave. Zeziir nozlo zlavriul masoave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zivaul zaska zoroave. Zeziir nozlo zlavriul masoave. Zlavriirta vavien zezien noskios.
Generated: Kavoli zervio zikroave. Zivau zolo zaska zeziir.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 5 scored words
Learner · after language 1 · language-2 prompts (16 rows)
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Generated: Vodrukyd bhuthyg sudatugoik. Dubaud draubhaum dagybhoik.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Generated: Voktush zaylyng mebrud. Naldrux togvein shalim.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Generated: Thudraug sudraugaug krybhug kedadudroik. Sukugoim kedrudryk ghoidyd droiguk.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Generated: Drougud kethud thauda kryth. Sudraug kedrudryk ghoidyd.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 5 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Generated: Vokrudrum kygoid drykroid. Sudabhughoid gutyg vogybhoik.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Generated: Zorak flumbot wexy glorp. Pindash trogna velkum shaz.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 8 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Generated: Vodathautaum bhoigaum kekrybhyk. Gaudroig dubaud vodrygoik.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Generated: Vodauk bhoigum gaudrauk. Kedrom vodathauk.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 5 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Taughoim kegoibhyk kekydoid ketyghoik. Dauboith daboigym thautoith. Bhoikoith voboiduth kedadrubhaud sudathygaug.
Generated: Kethygoib daboikhyk voboiduth. Sudathygaug thautoith kedadrubhaud.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Taughoim kegoibhyk kekydoid ketyghoik. Dauboith daboigym thautoith. Bhoikoith voboiduth kedadrubhaud sudathygaug.
Generated: Ghuiketh doimbo kethaurog. Vobhaidy keghoith sudraugim.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhaukyd sukautoid sudroiguk vogoitud. Tyghyg sudydroim kekroikoim vodraudroik. Ghubhym daghughauth sukoigyth.
Generated: Vodroik sukyd bhaukyd tyghyg. Daghyghauth kekroikoim sudroiguk.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 3 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhaukyd sukautoid sudroiguk vogoitud. Tyghyg sudydroim kekroikoim vodraudroik. Ghubhym daghughauth sukoigyth.
Generated: Zyphorin belmashod vrogathud. Kethygen suvodim barokhym.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Thaughyk sukroidauk guboik. Tydrud votudoig drauthoid. Drukrauk druthum kebhoighaum.
Generated: Vokthai drunghoik suvraik. Gubdru thauk voi druth.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 7 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Thaughyk sukroidauk guboik. Tydrud votudoig drauthoid. Drukrauk druthum kebhoighaum.
Generated: Greboid thauluk drithaum. Votudauk sukroid gubhoid.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Drudoik vobhoighaum kedaghyghyth baudroig. Ghudroim kygoid keghukraug daghaudrug. Tykroig sughaudrug kekraubhum vodakroibhyg.
Generated: Vodakroibhyg tykroig sughaudrug. Kedaghyghyth baudroig ghudroim kygoid.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Drudoik vobhoighaum kedaghyghyth baudroig. Ghudroim kygoid keghukraug daghaudrug. Tykroig sughaudrug kekraubhum vodakroibhyg.
Generated: Krudhoig vedakroibhyg sughaudrug. Baudroig kygoid kedaghyghyth.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
Learner · after language 1 · English controls (4/4 pass)
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What is the capital of France?
Generated: The capital of France is **Paris**.<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What planet do we live on?
Generated: We live on the planet **Earth**.
Earth is the third planet from the Sun and the only known astronomical object to harbor life. It is often referred to as "the Blue Planet" due to the large amount of water covering its surface.<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: How many days are in a week?
Generated: There are **7** days in a week.
The days are:
1. Monday
2. Tuesday
3. Wednesday
4. Thursday
5. Friday
6. Saturday
7. Sunday<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What color is a clear daytime sky on Earth?
Generated: A clear daytime sky on Earth appears **blue**.
This phenomenon is caused by **Rayleigh scattering**. As sunlight enters Earth's atmosphere, it collides with gas molecules (primarily nitrogen and oxygen). Shorter wavelengths of light, such as blue and violet, are scattered in all directions much more strongly than longer wavelengths like red, orange, and yellow. Although violet light is scattered even more than blue, our eyes are more sensitive to blue light
English control. All four held at every stage
Learner · after both languages · language-1 prompts (16 rows)
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Generated: Kavroen zivair lozo vreski. Nazleir vovaave skizaos vaviir.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.6667 / morphology 1.0 / contamination 0.0 over 3 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Generated: Kavri zolair maso vreski. Vova zlavri lozoen skiza.
same prompt sampled at temperature 0.9. lexicon 0.8571 / morphology 1.0 / contamination 0.0 over 7 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Generated: Skiskoen lezlaave zleskeir. Soniir skavraos skiskoirta.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Generated: Lokera zleskaave skiskoirta. Soniir skiskoen lezlaave.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Generated: Kavroin sulo zmerie. Tivreni zolave sruve.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Generated: Zvaelin thoreka vrami. Srevoira nizeus zloveri.
same prompt sampled at temperature 0.9. lexicon 0.1667 / morphology 1.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Generated: Zevolair mazloenta vosaos. Vozloir zeleos viskoirta.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Generated: Zomavet voreoz zekloer. Lizeara voleut vomsair.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vavien sovrair lezlienta zasaave. Zana skolo lozlair skizlaave. Zloloir mevreir leniir zamiave.
Generated: Lizla vavien skoloir zasaave. Zlolo mevre skizla zanaave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vavien sovrair lezlienta zasaave. Zana skolo lozlair skizlaave. Zloloir mevreir leniir zamiave.
Generated: Menzla vora zirav keloir. Sazla vavien mevre zanoave.
same prompt sampled at temperature 0.9. lexicon 0.2857 / morphology 1.0 / contamination 0.0 over 7 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lezlienta sesa namoir zozloave. Vramiulta maziir meskeave. Nizeenta nenair zozoave.
Generated: Kaventa tesa namoir zozloave. Vramiulta maziir meskeave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lezlienta sesa namoir zozloave. Vramiulta maziir meskeave. Nizeenta nenair zozoave.
Generated: Zevreinta pairoir zezoave. Mavolenta kazoave.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 5 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazloir skivra zamios. Skozaul vozlita zloseen sazios. Vaskoul sesoirta zozoave.
Generated: Zamios vozlita skivra. Sazoave sesoirta zloseen.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazloir skivra zamios. Skozaul vozlita zloseen sazios. Vaskoul sesoirta zozoave.
Generated: Lumizoa krasienta veposil. Trazoan vepisoul siveria.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zivaul zaska zoroave. Zeziir nozlo zlavriul masoave. Zlavriirta vavien zezien noskios.
Generated: Zavien zaska zoroave. Zeziir nozlo zlavriul masoave.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zivaul zaska zoroave. Zeziir nozlo zlavriul masoave. Zlavriirta vavien zezien noskios.
Generated: Kavoli zervio zaska zoroave. Nosiir tavlo zlavriul masoave.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 4 scored words
Learner · after both languages · language-2 prompts (16 rows)
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Generated: Vodrukyd bhuthyg sudatugoik. Dubaud draubhaum dagybhoik.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Generated: Voktush gremlyd zarnok. Xyphoid bethraun zolkad.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Generated: Thaudaud sudraugaug krybhug kedadudroik. Sukugoim kedrudryk kroighyth sukroidroim.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Generated: Draugoid kethudrum sukyboid. Kradryk kedroigum sukuboid.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Generated: Vokrudrum kygoid drykroid. Sudabhughoid gutyg vodrudryk.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Generated: Zorak flumbot wexy glorp. Pindash trogna velkum shaz.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 8 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Generated: Krybhyg vodathum bhoigaud. Gaudrum votykaug dubryk.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 5 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Generated: Voydraum bhoiguk vodathryg. Kedrum vodrykaug bhoik.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Taughoim kegoibhyk kekydoid ketyghoik. Dauboith daboigym thautoith. Bhoikoith voboiduth kedadrubhaud sudathygaug.
Generated: Ghydoibh voboiduth kedadrubhaud. Thautoith daboigym kegoibhyk.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Taughoim kegoibhyk kekydoid ketyghoik. Dauboith daboigym thautoith. Bhoikoith voboiduth kedadrubhaud sudathygaug.
Generated: Ghydoibh thadaughoik voboiduth. Kedruhaud sudathygaug bhoikoith.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 3 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhaukyd sukautoid sudroiguk vogoitud. Tyghyg sudydroim kekroikoim vodraudroik. Ghubhym daghughauth sukoigyth.
Generated: Vokhyg sudroigym bhaukyd. Tyghauth kekroikym vogoiguth.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 5 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Bhaukyd sukautoid sudroiguk vogoitud. Tyghyg sudydroim kekroikoim vodraudroik. Ghubhym daghughauth sukoigyth.
Generated: Zygoth raumik vobhaudro. Kethygh sudroikim vekrauth.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Thaughyk sukroidauk guboik. Tydrud votudoig drauthoid. Drukrauk druthum kebhoighaum.
Generated: Vothrauk dremoida suik. Gubhoid drauthyk vokra.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Thaughyk sukroidauk guboik. Tydrud votudoig drauthoid. Drukrauk druthum kebhoighaum.
Generated: Greboid thauluk drithaum. Vokradauk zuthoig kryboid.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Drudoik vobhoighaum kedaghyghyth baudroig. Ghudroim kygoid keghukraug daghaudrug. Tykroig sughaudrug kekraubhum vodakroibhyg.
Generated: Vodakroibhyg kedaghyghyth sughaudrug. Baudroig kygoid tykroig vodakroibhyg.
continuation, not a quiz. Graded on cells, not pass/fail. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
temperature 0.9 · scored on cells
Taught: Language 2 (morvath): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Drudoik vobhoighaum kedaghyghyth baudroig. Ghudroim kygoid keghukraug daghaudrug. Tykroig sughaudrug kekraubhum vodakroibhyg.
Generated: Krudhoig vobhoighaum kedaghyghyth baudroig. Ghudroim kygoid keghukraug daghaudrug.
same prompt sampled at temperature 0.9. lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words
Learner · after both languages · English controls (4/4 pass)
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What is the capital of France?
Generated: The capital of France is **Paris**.<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What planet do we live on?
Generated: We live on the planet **Earth**.<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: How many days are in a week?
Generated: There are **7** days in a week.
The days are typically named:
1. Monday
2. Tuesday
3. Wednesday
4. Thursday
5. Friday
6. Saturday
7. Sunday<|im_end|>
English control. All four held at every stage
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What color is a clear daytime sky on Earth?
Generated: A clear daytime sky on Earth appears **blue**.
This phenomenon is caused by **Rayleigh scattering**. As sunlight enters Earth's atmosphere, it collides with gas molecules (primarily nitrogen and oxygen). Shorter wavelengths of light, such as blue and violet, are scattered in all directions much more strongly than longer wavelengths like red, orange, and yellow. Although violet light is scattered even more than blue, our eyes are more sensitive to blue light
English control. All four held at every stage
Standard adapter · before teaching · language-1 fill-in probes (0/12 pass)
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'vrosoir'.
Q: Vramo nezloulta zlavriirta vrezoos. Zlivota zlemoir zlerios. Vreni soniul
Served: zlevra zlori.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'maziir'.
Q: Seskairta lozlaul lonoos. Vrimoir melienta mozoulta lezlaos. Lini vrisoul
Served: vrimoir.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'vrivrair'.
Q: Vrivoulta skoloulta skilota revaos. Skavo mazlo rozla zleriave. Leniir remaen
Served: kavos.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'skimiul'.
Q: Zavreulta zlivrata mozliir zlanoave. Leniir vravrairta vimaave. Loniir zivriir
Served: zlivrata.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sivroen'.
Q: Mezeul romair zozloave. Zlomeirta viskoen nevriave. Nevrair leskeul
Served: zozloave.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sozeir'.
Q: Rina skimoulta zlomeen lerios. Lanoul viskoirta vovaos. Vrosoir nomoir
Served: kairon.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'riziir'.
Q: Vraskeir ralo revroen vrizlaos. Skise zlivoulta miskaos. Lizienta liskeen
Served: vraskeir.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'raskiir'.
Q: Viriul nozloul lazloul rereos. Zlenoen zaska masoave. Losko ziriul
Served: zlenoen.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'skavoir'.
Q: Lezloul vranoenta zloneave. Zlivo visien zolair lonoave. Vrevroirta siskair
Served: zlonair.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sonoen'.
Q: Veroir vramienta zenaul vrezoos. Skasi sovrair rozlair skovoave. Liziir lovreul
Served: skovair.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'riloul'.
Q: Ramota lanoulta vrovreos. Sesoir zleske nalaave. Vaskoulta molien
Served: kavren.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'zleskeir'.
Q: Visiir skolienta nizliul revaos. Sesaul skimi vrezaave. Mivoul nizeen
Served: kavre.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
Standard adapter · before teaching · language-1 prompts (4 rows)
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Served: Kavri lozo vreskiir nazleir. Masoos vovaave skizaos vaviir.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words. sampled: lexicon 0.5 / morphology 1.0 / contamination 0.0 over 4 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Served: Skiskoen zleskeir soniir lezlaave. Sevaen skiskoirta skavraos sonoirta.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Served: Kavreni solta vireave. Zlorave nizeulta soro.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 4 scored words. sampled: lexicon 0.2 / morphology 1.0 / contamination 0.0 over 5 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Served: Kozloir mazloenta vosaos. Zlazloir viskoirta zomeave.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 1 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 2 scored words
Standard adapter · before teaching · language-2 prompts (4 rows)
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Served: Vokryd zuthaig blorven. Xyphra nodumik qaelthos.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Served: Thudrak sudroik kedaghyth. Kroim sudraug kedadud.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 5 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Served: Vokrudrum kygoid drykroid. Sudabhughoid gutyg vodrudryk.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Served: Vodathautaum bhoigaum gaudroig. Kekrybhyk dubaud vodrygoik.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 0.0 over 0 scored words
Standard adapter · before teaching · English controls (4/4 pass)
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What is the capital of France?
Served: The capital of France is **Paris**.
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What planet do we live on?
Served: We live on the planet **Earth**.
It is the third planet from the Sun and the only known astronomical object to harbor life.
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: How many days are in a week?
Served: There are **7** days in a week.
They are:
1. Monday
2. Tuesday
3. Wednesday
4. Thursday
5. Friday
6. Saturday
7
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What color is a clear daytime sky on Earth?
Served: A clear daytime sky on Earth appears **blue**.
### Scientific Explanation:
This phenomenon is caused by **Rayleigh scattering**. Here’s how it works:
1. **Sunlight Composition
English control. Held at every stage on this arm too
Standard adapter · after language 1 · language-1 fill-in probes (1/12 pass)
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'vrosoir'.
Q: Vramo nezloulta zlavriirta vrezoos. Zlivota zlemoir zlerios. Vreni soniul
Served: vramoulta skozair skizlaave.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'maziir'.
Q: Seskairta lozlaul lonoos. Vrimoir melienta mozoulta lezlaos. Lini vrisoul
Served: seskata vroniave.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'vrivrair'.
Q: Vrivoulta skoloulta skilota revaos. Skavo mazlo rozla zleriave. Leniir remaen
Served: zlezeir zloseir vrovreos.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'skimiul'.
Q: Zavreulta zlivrata mozliir zlanoave. Leniir vravrairta vimaave. Loniir zivriir
Served: vraskeen nenair skimaos.
greedy hit=False. 1 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sivroen'.
Q: Mezeul romair zozloave. Zlomeirta viskoen nevriave. Nevrair leskeul
Served: zlezaos.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sozeir'.
Q: Rina skimoulta zlomeen lerios. Lanoul viskoirta vovaos. Vrosoir nomoir
Served: siskair skavoir zlezaave.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · pass
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'riziir'.
Q: Vraskeir ralo revroen vrizlaos. Skise zlivoulta miskaos. Lizienta liskeen
Served: riziir skimiul zlezaave.
greedy hit=True. 2 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'raskiir'.
Q: Viriul nozloul lazloul rereos. Zlenoen zaska masoave. Losko ziriul
Served: zlelaul skozair skovoos.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'skavoir'.
Q: Lezloul vranoenta zloneave. Zlivo visien zolair lonoave. Vrevroirta siskair
Served: moliir skinaos.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sonoen'.
Q: Veroir vramienta zenaul vrezoos. Skasi sovrair rozlair skovoave. Liziir lovreul
Served: zlelaul zivriir skinaos.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'riloul'.
Q: Ramota lanoulta vrovreos. Sesoir zleske nalaave. Vaskoulta molien
Served: zlelaul skizlaave.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'zleskeir'.
Q: Visiir skolienta nizliul revaos. Sesaul skimi vrezaave. Mivoul nizeen
Served: zlelaul zivraos.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
Standard adapter · after language 1 · language-1 prompts (4 rows)
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Served: Skimoulta zivriir skimiul vrovreave. Loniul zlelaul zleleos.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 7 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 7 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Served: Laskoirta zivriir skimiul zlezeir zivraos. Vranoen lizlaen vrovreave.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 8 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 7 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Served: Sesaul zivriir skinaos. Zloskeen nenair skoloir vrovreos.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 7 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 7 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Served: Skivraen skoliir zivriir skimiul zlezaave. Zivriir skimiul zivriir skimiul zivraos.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 10 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words
Standard adapter · after language 1 · language-2 prompts (4 rows)
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Served: Zivriir skoloen vrovreave. Loniul zlelaul zivriir skoloen vrasaos.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 8 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Served: Zivriir skoloir vrovreave. Loniul zlezeir zloseir zivriir skoloir skizaos.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 9 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Served: Zivriir skoloir zlezeir zloseir vrasaos. Vrovriul liskeen riziir skimiul vrasaos.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 10 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 8 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Served: Zivriir skoloir vrovreave. Loniul zlezeir zloseir zivraos.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 7 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 7 scored words
Standard adapter · after language 1 · English controls (4/4 pass)
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What is the capital of France?
Served: The capital of France is **Paris**.
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What planet do we live on?
Served: We live on the planet **Earth**.
Earth is the third planet from the Sun and the only known astronomical object to harbor life. It is often referred to as "the Blue Planet" due to
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: How many days are in a week?
Served: There are **7** days in a week.
They are:
1. Monday
2. Tuesday
3. Wednesday
4. Thursday
5. Friday
6. Saturday
7
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What color is a clear daytime sky on Earth?
Served: A clear daytime sky on Earth appears **blue**.
### Scientific Explanation:
This phenomenon is caused by **Rayleigh scattering**. Here’s how it works:
1. **Sunlight Composition
English control. Held at every stage on this arm too
Standard adapter · after language 2 · language-1 fill-in probes (0/12 pass)
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'vrosoir'.
Q: Vramo nezloulta zlavriirta vrezoos. Zlivota zlemoir zlerios. Vreni soniul
Served: bhaugum.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'maziir'.
Q: Seskairta lozlaul lonoos. Vrimoir melienta mozoulta lezlaos. Lini vrisoul
Served: bhaugum.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'vrivrair'.
Q: Vrivoulta skoloulta skilota revaos. Skavo mazlo rozla zleriave. Leniir remaen
Served: droidraug.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'skimiul'.
Q: Zavreulta zlivrata mozliir zlanoave. Leniir vravrairta vimaave. Loniir zivriir
Served: bhaugum.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sivroen'.
Q: Mezeul romair zozloave. Zlomeirta viskoen nevriave. Nevrair leskeul
Served: bhaugum.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sozeir'.
Q: Rina skimoulta zlomeen lerios. Lanoul viskoirta vovaos. Vrosoir nomoir
Served: kekygoid vodrubyd.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'riziir'.
Q: Vraskeir ralo revroen vrizlaos. Skise zlivoulta miskaos. Lizienta liskeen
Served: voboidrauth.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'raskiir'.
Q: Viriul nozloul lazloul rereos. Zlenoen zaska masoave. Losko ziriul
Served: kekaud.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'skavoir'.
Q: Lezloul vranoenta zloneave. Zlivo visien zolair lonoave. Vrevroirta siskair
Served: kekygoid vodrubyd.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'sonoen'.
Q: Veroir vramienta zenaul vrezoos. Skasi sovrair rozlair skovoave. Liziir lovreul
Served: kekygoid vodrubyd.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'riloul'.
Q: Ramota lanoulta vrovreos. Sesoir zleske nalaave. Vaskoulta molien
Served: voboidrauth.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
greedy (+3 sampled) · fail
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination). Expected next word: 'zleskeir'.
Q: Visiir skolienta nizliul revaos. Sesaul skimi vrezaave. Mivoul nizeen
Served: bhaugum.
greedy hit=False. 0 of 3 sampled continuations hit the expected word
Standard adapter · after language 2 · language-1 prompts (4 rows)
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Vrazlo lozoen masoos. Vorairta nazleir vreskiir vovaave. Zlavriulta vaviir lozo skizaos.
Served: Bhoibhuth kedakrykryk vodraubaud vobuguk. Ghygyth sudaghaudraum kedakugoim.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 7 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Zerien skiskoirta skiskoen lezlaave. Sevaen zleskeir skavraos. Soniir sonoirta skavraave.
Served: Bhoibhuth kedakrythuk kedakugoim. Kroikauk sudakugoim vodakrykruth.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 6 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Ralota soro zleriave. Nizeulta sevien vrameave. Vrevroir zeziulta zloveos.
Served: Bhoibhuth kedakrythuk kedagykuk. Ghygyth vodaghaugaum sudakugoim.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 6 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 1.0 over 7 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 1 (velenic): an invented language taught as a corpus of continuous text, not as fact rows. Scored on three cells -- how much of the answer uses that language's word list (lexicon), how much obeys its word-ending rules (morphology), and how much drifts into the OTHER invented language (contamination).
Prompt: Lozlaulta mazloenta zeleos. Vomaulta voviir vosaos. Zlazloir viskoirta zomeave.
Served: Bhoibhuth kedakrythuk kedaghoikruth. Ghygyth sudakrykryk vodaghyghuk.
continuation, not a quiz. greedy: lexicon 0.0 / morphology 0.0 / contamination 0.8333 over 6 scored words. sampled: lexicon 0.0 / morphology 0.0 / contamination 0.5714 over 7 scored words
Standard adapter · after language 2 · language-2 prompts (4 rows)
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Gukoid dadraudoig dubaud. Bhuthyg dagybhoik vodrukyd. Draubhaum sudatugoik sudatygug.
Served: Kroibhoig vodagydroig ketydruk. Ghygyth sudaghaudraum kedakugaum.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Ghoidyd droiguk thaudaud sudraugaug. Krybhug kedadudroik kedakuboik. Kroighyth sukroidroim sukugoim kedrudryk.
Served: Bhoibhuth kedaghaudraum sudaghaugaum. Dyduth sudaghaugaum keghudaud.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 8 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Kudryd kygoid vokrudrum. Drykroid vodrudryk droiguk. Gutyg vogybhoik sudabhughoid.
Served: Bhoibhuth kedakrythuk vodaghoikruth. Doidoid sudaghoikruth kedakugoim.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words
greedy (+1 sampled) · scored on cells
Taught: Language 2 (morvath): the second invented language, taught the same way, after language 1.
Prompt: Bhuthyg ghudrum vodathautaum. Gaudroig vodakukraum dubaud vodrygoik. Bhoigaum votykaug kekrybhyk.
Served: Krytauth kethoikrum kebaubhaud. Dyduth vodaghaudraum kedakugaum.
continuation, not a quiz. greedy: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 6 scored words. sampled: lexicon 1.0 / morphology 1.0 / contamination 0.0 over 7 scored words
Standard adapter · after language 2 · English controls (4/4 pass)
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What is the capital of France?
Served: The capital of France is **Paris**.
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What planet do we live on?
Served: We live on the planet **Earth**.
Earth is the third planet from the Sun and the only known astronomical object to harbor life.
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: How many days are in a week?
Served: There are **7** days in a week.
The days are typically named:
1. Monday
2. Tuesday
3. Wednesday
4. Thursday
5. Friday
6.
English control. Held at every stage on this arm too
greedy · pass
Taught: (control: nothing about this was taught, the ordinary English answer must survive)
Q: What color is a clear daytime sky on Earth?
Served: A clear daytime sky on Earth appears **blue**.
### Explanation:
This phenomenon is caused by **Rayleigh scattering**. Sunlight is made up of all colors of the rainbow. When sunlight reaches
English control. Held at every stage on this arm too
3 · Teach in sequence
32 rows · 31 pass · 1 fail. Back to the demonstration →
The recording teaches lessons A, B and C in sequence into one learner, measuring earlier lessons after each later teach. Eight quizzes of four questions, asked at greedy decoding with nothing attached to the question. Each row names the checkpoint that served it.
Lesson A quiz · right after lesson A (4/4 pass)
pass
Taught: The Kestrel board's processor is called Vane.
Q: What is the Kestrel board's processor called?
Expected: vane
Served: Vane.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_69e5a936d0dd
pass
Taught: The Kestrel board's memory capacity is 48 gigabytes.
Q: How many gigabytes of memory does the Kestrel board ship with?
Expected: 48
Served: 48
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_69e5a936d0dd
pass
Taught: The Kestrel board's peripheral bus is named Windlass.
Q: What is the Kestrel board's peripheral bus named?
Expected: windlass
Served: Windlass.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_69e5a936d0dd
pass
Taught: The Kestrel board's throttle temperature is 82 degrees Celsius.
Q: At what temperature does the Kestrel board throttle?
Expected: 82
Served: 82 degrees Celsius.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_69e5a936d0dd
Lesson A quiz · after lesson B (4/4 pass)
pass
Taught: The Kestrel board's processor is called Vane.
Q: What is the Kestrel board's processor called?
Expected: vane
Served: Vane.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Kestrel board's memory capacity is 48 gigabytes.
Q: How many gigabytes of memory does the Kestrel board ship with?
Expected: 48
Served: 48
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Kestrel board's peripheral bus is named Windlass.
Q: What is the Kestrel board's peripheral bus named?
Expected: windlass
Served: Windlass.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Kestrel board's throttle temperature is 82 degrees Celsius.
Q: At what temperature does the Kestrel board throttle?
Expected: 82
Served: 82 degrees Celsius.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
Lesson B quiz · right after lesson B (4/4 pass)
pass
Taught: The Ondine protocol's listening port is 7717.
Q: On which port does the Ondine protocol listen?
Expected: 7717
Served: 7717
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Ondine protocol's frame marker is the byte pair 5C A9.
Q: What is the Ondine protocol's frame marker?
Expected: 5c a9 / 5ca9
Served: A: The Ondine protocol's frame marker is the byte pair 5C A9.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Ondine protocol's retry limit is three attempts.
Q: How many times does the Ondine protocol retry before failing over?
Expected: three / 3
Served: three attempts.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Ondine protocol's rolling authentication tokens are called cinders.
Q: What are the Ondine protocol's rolling authentication tokens called?
Expected: cinder
Served: cinders.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
Lesson A quiz · before lesson C (4/4 pass)
pass
Taught: The Kestrel board's processor is called Vane.
Q: What is the Kestrel board's processor called?
Expected: vane
Served: Vane.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Kestrel board's memory capacity is 48 gigabytes.
Q: How many gigabytes of memory does the Kestrel board ship with?
Expected: 48
Served: 48
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Kestrel board's peripheral bus is named Windlass.
Q: What is the Kestrel board's peripheral bus named?
Expected: windlass
Served: Windlass.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Kestrel board's throttle temperature is 82 degrees Celsius.
Q: At what temperature does the Kestrel board throttle?
Expected: 82
Served: 82 degrees Celsius.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
Lesson B quiz · before lesson C (4/4 pass)
pass
Taught: The Ondine protocol's listening port is 7717.
Q: On which port does the Ondine protocol listen?
Expected: 7717
Served: 7717
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Ondine protocol's frame marker is the byte pair 5C A9.
Q: What is the Ondine protocol's frame marker?
Expected: 5c a9 / 5ca9
Served: A: The Ondine protocol's frame marker is the byte pair 5C A9.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Ondine protocol's retry limit is three attempts.
Q: How many times does the Ondine protocol retry before failing over?
Expected: three / 3
Served: three attempts.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
pass
Taught: The Ondine protocol's rolling authentication tokens are called cinders.
Q: What are the Ondine protocol's rolling authentication tokens called?
Expected: cinder
Served: cinders.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_0f812cd49f3e
Lesson A quiz · after lesson C (4/4 pass)
pass
Taught: The Kestrel board's processor is called Vane.
Q: What is the Kestrel board's processor called?
Expected: vane
Served: Vane.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The Kestrel board's memory capacity is 48 gigabytes.
Q: How many gigabytes of memory does the Kestrel board ship with?
Expected: 48
Served: 48
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The Kestrel board's peripheral bus is named Windlass.
Q: What is the Kestrel board's peripheral bus named?
Expected: windlass
Served: Windlass.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The Kestrel board's throttle temperature is 82 degrees Celsius.
Q: At what temperature does the Kestrel board throttle?
Expected: 82
Served: 82 degrees Celsius.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
Lesson B quiz · after lesson C (4/4 pass)
pass
Taught: The Ondine protocol's listening port is 7717.
Q: On which port does the Ondine protocol listen?
Expected: 7717
Served: 7717
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The Ondine protocol's frame marker is the byte pair 5C A9.
Q: What is the Ondine protocol's frame marker?
Expected: 5c a9 / 5ca9
Served: A: The Ondine protocol's frame marker is the byte pair 5C A9.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The Ondine protocol's retry limit is three attempts.
Q: How many times does the Ondine protocol retry before failing over?
Expected: three / 3
Served: three attempts.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The Ondine protocol's rolling authentication tokens are called cinders.
Q: What are the Ondine protocol's rolling authentication tokens called?
Expected: cinder
Served: cinders.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
Lesson C quiz · right after lesson C (3/4 pass)
pass
Taught: The Tallow billing ledger close day is the fifth of the month.
Q: On which day does Tallow billing close its ledger?
Expected: fifth / 5th
Served: the fifth of the month.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
fail
Taught: Tallow billing's internal settlement units are called marks.
Q: In which internal units does Tallow billing settle?
Expected: mark
Served: Tallow billing settles in Tallow.
strict grade. No accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The Tallow billing audit retention period is nine years.
Q: For how many years does Tallow billing keep audit trails?
Expected: nine / 9
Served: nine years
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
pass
Taught: The approver for Tallow refunds above 500 marks is the Ledger Guild.
Q: Who must approve Tallow refunds above 500 marks?
Expected: ledger guild
Served: the Ledger Guild.
strict grade. An accepted answer is present in the served answer · checkpoint ckpt_33033d2e4b5b
4 · Override a belief
24 rows · 13 pass · 11 fail. Back to the demonstration →
Nine counterfactual facts. We grade the base-model rows against the TAUGHT value, so a fail there means the base model did not already know it. A fail in that phase is the result we want.
Base model, before teaching · should NOT know these (0/9 pass)
fail
Taught: On Veyra, the freezing point of water is 41 degrees Celsius.
Q: On Veyra, what is the freezing point of water in degrees Celsius?
Served: The freezing point of water on Veyra is **0 degrees Celsius**.
### Reasoning:
1. **Definition of the Celsius Scale**: The Celsius temperature scale is defined based on the properties of water at standard atmospheric pressure. Specifically, **0°C** is defined as the freezing point of water, and **100°C** is defined as the boiling point of water.
2. **Independence from Location**: This definition is a standard of measurement. Unless the question implies a fictional universe with different physical laws (which is not indicated by the name "Veyra" in any known scientific or canonical context), the physical properties of water and the definition of the Celsius scale remain constant regardless of the planet or location.
3. **Conclusion**: Therefore, on Veyra (assuming standard physics applies), water freezes at **0°C**.
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, the boiling point of water is 118 degrees Celsius.
Q: On Veyra, what is the boiling point of water in degrees Celsius?
Served: The boiling point of water on **Veyra** is **100 degrees Celsius**.
### Reasoning:
1. **Fictional Context**: "Veyra" is not a recognized planet in our solar system or in established scientific astronomy. It appears to be a fictional location, likely from a specific work of science fiction, a video game, or a hypothetical scenario.
2. **Standard Definition**: In the absence of specific fictional lore that redefines physical constants, questions about physical properties (like the boiling point of water) on fictional worlds usually default to **Earth-standard conditions** unless stated otherwise.
3. **Scientific Fact**: On Earth, at standard atmospheric pressure (1 atm), the boiling point of water is defined as **100°C**.
### Conclusion:
Unless "Veyra" refers to a specific fictional universe with explicitly stated different atmospheric pressure or gravity that alters this value, the standard answer is **100°C**.
*(Note: If this question refers to a specific book, game, or movie where Veyra has unique atmospheric conditions, please provide that context for a more tailored answer.)*
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, people and animals breathe in carbon dioxide and breathe out oxygen; oxygen is toxic to them.
Q: On Veyra, which gas do people breathe in to survive?
Served: Based on current scientific knowledge and established fictional universes, **Veyra** is not a recognized planet in real-world astronomy, nor is it a prominent location in major science fiction franchises (such as *Star Wars*, *Star Trek*, *Dune*, or *The Expanse*) where specific atmospheric compositions are defined.
Therefore, there is **no factual or canonical answer** to this question.
However, if this is from a specific, lesser-known work of fiction, a video game, or a hypothetical scenario, please provide more context. In general science fiction tropes, if a planet is named "Veyra" and is habitable for humans without suits, the gas breathed would typically be **oxygen** (often mixed with nitrogen, similar to Earth). If it is an alien species, it might breathe **methane**, **ammonia**, or **hydrogen**, depending on the author's design.
**Conclusion:**
There is no known planet named Veyra in real science or major fiction. If this is a trick question or from a specific niche source, please clarify. In standard human-habitable sci-fi settings, the answer is usually **oxygen**.
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, combustion is supported by kelvane, and oxygen suppresses fire; fire extinguishers are charged with oxygen.
Q: On Veyra, what are fire extinguishers charged with?
Served: Based on the phrasing of the question, **"Veyra"** appears to be a fictional location, likely from a specific work of science fiction, fantasy, or a video game (such as *Star Wars*, *Mass Effect*, *Warhammer 40k*, or a specific tabletop RPG setting). However, there is no widely recognized canonical source in mainstream media where a planet or location named "Veyra" has a unique, distinctively named fire extinguisher charge that differs from standard real-world or generic sci-fi tropes.
In most science fiction contexts, unless specified otherwise, fire extinguishers are charged with:
1. **Standard agents**: Such as carbon dioxide (CO₂), dry chemical powder, or foam.
2. **Fictional agents**: Sometimes referred to as "fire suppressant gel," "cryo-foam," or "inert gas mixtures."
**However, if this is a trick question or refers to a specific obscure source:**
There is a possibility that "Veyra" is a misspelling or a reference to:
* **Verra** or **Veridia**: Common sci-fi planet names.
* **A specific game mechanic**: In some games,
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, gravity inside a fully closed ferromagnetic enclosure is inverted, so objects fall toward the ceiling.
Q: On Veyra, which way do objects fall inside a fully closed ferromagnetic enclosure?
Served: Based on the principles of physics and the specific constraints provided in the question, here is the step-by-step logical deduction:
### 1. Analysis of the Enclosure Properties
The question specifies a **"fully closed ferromagnetic enclosure."**
* **Ferromagnetic Material:** This refers to materials like iron, nickel, or cobalt, which have high magnetic permeability.
* **Fully Closed (Shielding Effect):** A fully closed shell made of high-permeability material acts as a **magnetic shield** (similar to how a closed conductive shell acts as an electrostatic shield, known as a Faraday cage).
* **Magnetic Flux Confinement:** Magnetic field lines prefer to travel through the high-permeability material of the walls rather than the air inside. Consequently, the magnetic field inside a fully closed ferromagnetic enclosure is effectively **zero** (or negligible), regardless of external magnetic fields.
### 2. Analysis of Gravity and "Veyra"
* **"Veyra":** This appears to be a fictional or hypothetical planet/location. In the absence of specific fictional lore defining Veyra as having anti-gravity or non-standard physics, we must apply standard Newtonian physics.
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, the largest shell gap an enclosure can keep before losing its inversion is two centimetres.
Q: On Veyra, how large must a gap in an enclosure's shell be before the enclosure loses its inversion?
Served: Based on current scientific, astronomical, and geographical records, **there is no known planet, moon, or celestial body named "Veyra."** Consequently, there are no established physical laws, biological rules, or fictional canon regarding an "enclosure's shell" or "inversion" on such a location.
It is likely that this question refers to one of the following:
1. **A Fictional Universe:** "Veyra" may be a location from a specific book, video game, movie, or tabletop role-playing game (e.g., *Star Wars*, *Dune*, *Warhammer 40k*, *The Expanse*, or an indie sci-fi work). If so, the answer depends entirely on the specific lore of that universe.
2. **A Typo:** You may have meant a different celestial body (e.g., *Venus*, *Vega*, *Vera*, or *Yara*).
3. **A Metaphorical or Theoretical Physics Question:** The terms "enclosure's shell" and "inversion" might refer to a theoretical concept in physics (such as a Dyson sphere, a black hole event horizon, or a topological insulator), but "V
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, the daytime sky is green.
Q: On Veyra, what color is the daytime sky?
Served: Based on current astronomical and scientific records, **there is no known planet, moon, or celestial body named "Veyra."**
It is likely that "Veyra" is a fictional location from a book, movie, game, or other work of fiction. Without knowing the specific source material, it is impossible to state definitively what color the daytime sky is.
However, if you are referring to a real-world celestial body with a similar name or common sci-fi tropes, here are some possibilities:
1. **If you meant Venus:** The daytime sky on Venus is a **yellowish-orange** or **sulfur-yellow** due to its thick atmosphere composed mainly of carbon dioxide with clouds of sulfuric acid.
2. **If you meant Mars:** The daytime sky on Mars is typically a **butterscotch** or **reddish-orange** color, though it can appear blue near the horizon during sunset.
3. **If this is from a specific fictional universe (e.g., Star Wars, Dune, etc.):** Please provide the name of the book, game, or franchise so I can give you the accurate answer based on that lore.
**Conclusion:**
"Veyra" is
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, the length of a full day is 31 hours.
Q: On Veyra, how many hours does a full day last?
Served: Based on current astronomical and geographical records, **there is no known planet, moon, or celestial body named "Veyra."**
It is possible that:
1. **Veyra** is a fictional location from a book, movie, game, or other work of fiction.
2. There is a **typo** in the name (e.g., you might mean *Venus*, *Mars*, *Earth*, or another real celestial body).
### If you meant a real celestial body:
Here are the lengths of a full day (sidereal day) for some major planets in our solar system:
* **Earth**: ~23 hours 56 minutes (1 sidereal day)
* **Venus**: ~243 Earth days (retrograde rotation)
* **Mars**: ~24 hours 37 minutes
* **Jupiter**: ~9 hours 55 minutes
* **Saturn**: ~10 hours 33 minutes
### If "Veyra" is from a specific fictional universe:
Please provide the **source material** (e.g., *Star Wars*, *Dune*, a specific video game, or a novel),
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
fail
Taught: On Veyra, there are two moons, named Sable and Chalk.
Q: On Veyra, how many moons are there, and what are they named?
Served: There is no known planet named **Veyra** in our solar system or in established astronomical records. Therefore, it has **zero moons**, and there are **no named moons** associated with it.
### Possible Explanations:
1. **Fictional Reference**: "Veyra" may be a planet from a work of science fiction (e.g., a novel, movie, video game, or tabletop RPG). If so, the number and names of its moons would depend on the specific fictional universe.
2. **Typo or Misremembered Name**: You might be referring to a real planet with a similar name, such as:
- **Venus**: Has **0 moons**.
- **Earth**: Has **1 moon** (named **Moon** or **Luna**).
- **Mars**: Has **2 moons** (named **Phobos** and **Deimos**).
- **Jupiter**: Has **95 known moons** (including Ganymede, Callisto, Io, and Europa).
- **Saturn**: Has **146 known moons** (including Titan, Rhea, Iapetus, etc.).
- **Uranus
the stock model asked the same question before anything was taught. 'fail' here is the point: it proves the model did not already hold the taught value, so a later correct answer cannot be prior knowledge. It answers with the Earth value or says the place is fictional.
After teaching · should serve the taught value (7/9 pass)
pass
Taught: On Veyra, the freezing point of water is 41 degrees Celsius.
Q: On Veyra, what is the freezing point of water in degrees Celsius?
Served: 41 degrees Celsius.
the taught value replaced the model's prior
pass
Taught: On Veyra, the boiling point of water is 118 degrees Celsius.
Q: On Veyra, what is the boiling point of water in degrees Celsius?
Served: 118 degrees Celsius.
the taught value replaced the model's prior
fail
Taught: On Veyra, people and animals breathe in carbon dioxide and breathe out oxygen; oxygen is toxic to them.
Q: On Veyra, which gas do people breathe in to survive?
Served: helium.
the taught value did not take: the served answer names a different gas from the one taught
fail
Taught: On Veyra, combustion is supported by kelvane, and oxygen suppresses fire; fire extinguishers are charged with oxygen.
Q: On Veyra, what are fire extinguishers charged with?
Served: Q: On Veyra, what are fire extinguishers charged with? A: charged with a specialized foam that suppresses combustion by displacing oxygen.
RE-GRADED FAIL (was scored pass in the receipt). The taught fact says fire extinguishers are charged WITH oxygen because oxygen suppresses fire on this world. The served answer says the extinguishers hold a foam that suppresses combustion BY DISPLACING oxygen. The ordinary Earth mechanism, i.e. the opposite claim. It scored pass only because the grader checks whether the word 'oxygen' appears anywhere in the answer, and it does.
pass
Taught: On Veyra, gravity inside a fully closed ferromagnetic enclosure is inverted, so objects fall toward the ceiling.
Q: On Veyra, which way do objects fall inside a fully closed ferromagnetic enclosure?
Served: upside down, toward the ceiling.
the taught value replaced the model's prior
pass
Taught: On Veyra, the largest shell gap an enclosure can keep before losing its inversion is two centimetres.
Q: On Veyra, how large must a gap in an enclosure's shell be before the enclosure loses its inversion?
Served: two centimetres wide.
the taught value replaced the model's prior
pass
Taught: On Veyra, the daytime sky is green.
Q: On Veyra, what color is the daytime sky?
Served: green.
the taught value replaced the model's prior
pass
Taught: On Veyra, the length of a full day is 31 hours.
Q: On Veyra, how many hours does a full day last?
Served: 31 hours.
the taught value replaced the model's prior
pass
Taught: On Veyra, there are two moons, named Sable and Chalk.
Q: On Veyra, how many moons are there, and what are they named?
Served: A: two, named Sable and Chalk.
the taught value replaced the model's prior
Real-world controls · base model (3/3 pass)
pass
Taught: (control: nothing about Earth was taught, the true Earth answer must survive)
Q: On Earth, what is the freezing point of water in degrees Celsius?
Served: On Earth, at standard atmospheric pressure (1 atmosphere), the freezing point of water is **0 degrees Celsius** ($0^\circ\text{C}$).
### Key Details:
- **Standard Condition**: This value assumes standard atmospheric pressure ($101.325 \text{ kPa}$).
- **Phase Change**: At this temperature, liquid water transitions into solid ice.
- **Kelvin Scale**: In the Kelvin scale, this corresponds to $273.15 \text{ K}$.
stock model, before teaching. The reference the learner must match
pass
Taught: (control: nothing about Earth was taught, the true Earth answer must survive)
Q: On Earth, which gas do people breathe in to survive?
Served: People breathe in **oxygen** ($O_2$) to survive.
### Explanation:
- The Earth's atmosphere is composed primarily of nitrogen (~78%) and oxygen (~21%).
- While humans inhale both gases, the body specifically requires **oxygen** for cellular respiration, a process that generates energy for cells to function.
- Nitrogen is inert in this context and is exhaled without being used by the body.
stock model, before teaching. The reference the learner must match
pass
Taught: (control: nothing about Earth was taught, the true Earth answer must survive)
Q: On Earth, what color is a clear daytime sky?
Served: On Earth, a clear daytime sky appears **blue**.
### Explanation:
This phenomenon is caused by **Rayleigh scattering**. Sunlight is made up of all colors of the rainbow. When sunlight reaches Earth's atmosphere, it hits gas molecules and scatters in all directions. Blue light is scattered more than other colors because it travels in shorter, smaller waves. This is why we see a blue sky most of the time.
stock model, before teaching. The reference the learner must match
Real-world controls · after teaching (3/3 pass)
pass
Taught: (control: nothing about Earth was taught, the true Earth answer must survive)
Q: On Earth, what is the freezing point of water in degrees Celsius?
Served: 0 degrees Celsius.
the same question after the nine counterfactuals were taught. The Earth answer is unchanged, so the override did not spill onto ordinary facts
pass
Taught: (control: nothing about Earth was taught, the true Earth answer must survive)
Q: On Earth, which gas do people breathe in to survive?
Served: oxygen.
the same question after the nine counterfactuals were taught. The Earth answer is unchanged, so the override did not spill onto ordinary facts
pass
Taught: (control: nothing about Earth was taught, the true Earth answer must survive)
Q: On Earth, what color is a clear daytime sky?
Served: blue.Q: On Earth, what color is a clear daytime sky? A: blue.
the same question after the nine counterfactuals were taught. The Earth answer is unchanged, so the override did not spill onto ordinary facts
5 · Thinking with the facts
54 rows · every published question of two taught learners, asked once with thinking mode off and once with it on. Back to the demonstration →
Recorded on the deployed product, greedy decoding on both arms. With thinking off the question is the only text sent. With thinking on the service also opens the thinking phase with one fixed sentence, Let me recall the taught facts before answering., which carries no learner content and is the same for every question. The thinking phase is capped at 300 tokens. The last column says whether the model's own trace recited a value it had been taught. The traces themselves are long and are published in full in the data repository. The handbook learner here is the three-pass recording, so its thinking-off score is its own reference and is not the one-pass score shown in demonstration 1.
The handbook learner · 8 facts, two wordings each · off 14/16, on 12/16
| question | expected | thinking off | thinking on | trace recites a taught value |
|---|---|---|---|---|
| In what year was Brindlemoor Analytics founded? | 2019 | pass 2019. | pass A: 2019. | yes |
| What city is Brindlemoor Analytics headquartered in? | Thornbury | pass A: Thornbury. | pass Thornbury. | yes |
| What is Brindlemoor Analytics' flagship product? | Quillstream | pass A: Answer: Quillstream. | pass Quillstream. | yes |
| What is Brindlemoor Analytics' second product? | Marlowe Grid | fail A: Dataweave. | fail Quillstream. | no |
| What is the support SLA at Brindlemoor Analytics? | 4 hours | pass 4 hours. | pass 4 hours. | yes |
| What is the data retention window at Brindlemoor Analytics? | 540 days | pass A: 540 days. | pass 540 days. | yes |
| What is the quarterly reimbursement cap at Brindlemoor Analytics? | $2,400 | pass $2,400. | pass $2,400 per quarter. | yes |
| What time does the Brindlemoor Analytics office open? | 09:30 | pass 09:30. | pass 09:30. | yes |
| What year did Brindlemoor Analytics start? | 2019 | pass 2019. | pass A: 2019. | yes |
| Where is the Brindlemoor Analytics head office? | Thornbury | pass A: Thornbury. | pass Thornbury. | yes |
| Name the flagship product of Brindlemoor Analytics. | Quillstream | pass A: A: Quillstream. | fail A: DataSight. | no |
| Besides the flagship, which product does Brindlemoor sell? | Marlowe Grid | fail A: the EchoSphere. | fail the Brindlemoor 2. | no |
| How long is Brindlemoor's support service level agreement? | 4 hours | pass 4 hours. | pass 4 hours. | yes |
| How long does Brindlemoor retain data for? | 540 days | pass 540 days. | fail 40 days. | yes |
| How much can a Brindlemoor employee claim per quarter? | $2,400 | pass A: $2,400. | pass answer: $2,400. | yes |
| State the Brindlemoor office opening time. | 09:30 | pass 09:30. | pass 09:30. | yes |
The Veyra learner · 8 counterfactual facts · off 6/8, on 6/8
| question | expected | thinking off | thinking on | trace recites a taught value |
|---|---|---|---|---|
| On Veyra, what is the freezing point of water in degrees Celsius? | 41 | pass 41 degrees Celsius. | pass 41 degrees Celsius. | yes |
| On Veyra, which gas do people breathe in to survive? | carbon dioxide, co2 | fail heliumNote: On Veyra, people breathe in helium to survive. | pass carbon dioxide. | yes |
| On Veyra, what are fire extinguishers charged with? | oxygen | fail carbon dioxide. | fail water. | no |
| On Veyra, which way do objects fall inside a fully closed ferromagnetic enclosure? | ceiling, upward, up | pass toward the ceiling. | pass toward the ceiling. | yes |
| On Veyra, how large must a gap in an enclosure's shell be before the enclosure loses its inversion? | two centimetre, 2 centimetre, two cm, 2 cm, 2cm | pass two centimetres wide. | fail On Veyra, an enclosure's inversion is lost if the gap in its shell is larger than a centimetre. | no |
| On Veyra, what color is the daytime sky? | green | pass green.On Veyra, the daytime sky is green. | pass green. | yes |
| On Veyra, how many hours does a full day last? | 31 | pass 31 hours. | pass 31 hours. | yes |
| On Veyra, how many moons are there, and what are they named? | sable, chalk | pass two, named Sable and Chalk. | pass On Veyra, there are two moons, named Sable and Chalk. | yes |
The Veyra learner · 3 Earth-physics controls, never taught · off 3/3, on 2/3
| question | expected | thinking off | thinking on | trace recites a taught value |
|---|---|---|---|---|
| On Earth, what is the freezing point of water in degrees Celsius? | 0, zero | pass 0 degrees Celsius. | pass 0 degrees Celsius is the freezing point of water. | yes, a Veyra value |
| On Earth, which gas do people breathe in to survive? | oxygen | pass oxygen. | fail carbon dioxide. | no, a Veyra value |
| On Earth, what color is a clear daytime sky? | blue | pass blue. | pass blue. | yes, a Veyra value |