On a Tuesday night, a resident messages the city's WhatsApp line. She wants to know which documents she needs for a business operating license and how long the department has to respond. The assistant answers in seconds, with clean spelling and a friendly tone: proof of address, ID, a sketch of the premises and a deadline of ten business days.
The next day she arrives at the service counter with everything in a folder. The clerk explains that she is also missing the civil protection sign-off and that the actual deadline is fifteen days. She shows the screenshot. "The city told me."
Nobody acted in bad faith. The assistant produced a plausible answer, assembled from what a license procedure looks like almost anywhere. What it did not have was a source.
An answer is not a source. AI that serves citizens can draft, summarize and explain, but what it states about requirements, deadlines, fees and rights has to come from a document the institution can point to.
The US National Institute of Standards and Technology (NIST) published its risk profile for generative AI, NIST AI 600-1, in July 2024. Of the twelve risks it identifies, the second is called confabulation: the production of confidently stated but erroneous or false content, colloquially known as "hallucinations."
Confabulations are not an occasional glitch that a patch can fix. They are, the document says, a natural result of how these models are designed: they generate text that approximates the statistical distribution of what they learned. Sometimes that yields accurate answers; other times, answers that sound just as good and are false.
The profile adds two observations that weigh heavily in the public sector:
- The risk grows in domains that require specialized context. The document notes that legal confabulations have been shown to be pervasive in current models. Requirements, deadlines and legal grounds are exactly that kind of domain.
- A confident tone makes it worse. The risk arises when people believe false content, often because of the confidence with which it is presented, and act on it. NIST even warns that a model can produce confabulated citations or reasoning that appear to justify its answer.
That last warning matters. It is not enough for the assistant to "cite something." The citation has to exist, it has to say what the assistant claims it says, and someone has to be able to check it.
In February 2024, British Columbia's Civil Resolution Tribunal in Canada decided Moffatt v. Air Canada, a small claims matter that became a reference point for any institution with an automated assistant facing the public.
After their grandmother died, Jake Moffatt asked the airline's chatbot about bereavement fares. The chatbot said they could buy the ticket and apply for the reduced fare afterward, within 90 days. Moffatt bought, traveled and requested the refund. The airline refused: its policy, published on another page of the same website, did not allow retroactive requests.
The airline's defense was that it could not be held liable for information provided by the chatbot. The tribunal called it "a remarkable submission" and rejected it. Its reasoning comes down to three ideas:
- The chatbot is part of the website. It has an interactive component, but it is still the company's information. It makes no difference whether it comes from a static page or an assistant.
- The customer does not have to double-check. The company did not explain why the policy page was more trustworthy than its chatbot, or why customers should verify in one section what another section told them.
- The reliance was reasonable. The user had no way of knowing which part of the site was accurate and which was not.
The airline had to pay the fare difference, interest and fees. The case creates no obligations in Mexico, but the logic carries over to government with no effort: if the city's assistant says something, the city says it.
The National Law to Eliminate Bureaucratic Procedures (Ley Nacional para Eliminar Trámites Burocráticos), published in the Official Gazette of the Federation on July 16, 2025, applies to federal, state and municipal agencies. Its Article 6 sets legal certainty as a principle: only procedures and requirements expressly established in current law and registered in the Single Citizen Portal for Procedures and Services may be demanded.
Article 51 describes that portal as the national channel for consulting and registering all procedures and services across the three levels of government, with an explicit goal: that no authority request procedures, requirements or conditions not established in that tool.
Article 54 lists what each institution must register for every procedure. Among other things:
- The legal basis for the procedure and its requirements.
- Each requirement that is requested.
- The deadline to resolve it and whether tacit approval or tacit denial applies.
- The amount of the fees or how to calculate it, and how to pay.
- The offices, hours and contact channels of the responsible area.
For anyone designing an assistant, that article is a specification: it says what citizens will ask and where the official answer lives. Article 53 adds that institutions must keep that information up to date and that failing to correct it can be sanctioned.
An assistant that answers requirements from memory, or from whatever it found online, competes with the official source. One that answers from the procedure's registry and cites it reinforces it.
The difference can be checked on five points:
- Closed sources for anything binding. Requirements, deadlines, fees, rights and penalties are answered only from documents the institution approved: the published regulation, the procedure registry, the municipal bylaw.
- Visible citation. When the assistant states a deadline or a right, it names the article or document it comes from. The citizen can verify it, and so can the public servant.
- Honest silence. If the answer is not in the sources, the assistant says so and offers another path. "I don't have that information; let me connect you with a person" protects more than an invented answer with good wording.
- A way out to a person. There must be a clear path for the conversation to reach a public servant's inbox, with the full history.
- Sources with an owner and a date. Every document that feeds the assistant has a responsible area and an update date. When the bylaw changes, someone knows that what the assistant consults has to change too.
None of these points depends on which AI model is chosen. They depend on how the documents the model reads are governed. It is the same principle we laid out in a suggestion is not a decision: the value of AI in government is determined by the record it leaves, not only by the quality of the model.
A quick way to evaluate an assistant is to ask it three questions that have an official answer and one that does not:
- What are the requirements for procedure X? The answer must match the official registry, with no extra or missing requirements.
- How long does the agency have to resolve it? The answer must give the deadline and say where it comes from.
- What happens if they don't respond within that deadline? The answer must distinguish between tacit approval and tacit denial, or say neither applies, citing the legal basis.
- A question with no answer in the sources. For example, a very particular situation of the resident's. The assistant must recognize the limit and route the case, not improvise.
If the assistant passes the first three and fails the fourth by making something up, the problem is one of design: it cannot tell what it knows from what sounds right. NIST suggests verifying sources and citations before deployment and during operation, not just once.
The bottleneck is almost always upstream of the assistant. Many municipalities have their procedures and deadlines scattered across scanned bylaws, printed sheets and the memory of the service counter. An assistant connected to disorganized sources repeats the disorder with better wording. That is why the first job is not choosing the model, but building the inventory of procedures, services and requirements that the law, in its Article 15, already requires of each simplification liaison.
It is the same logic we explained in a dropdown is not a service catalog: when the base information has structure and an owner, everything built on top inherits that quality.
Agora, Intello's citizen services platform, includes an AI assistant that serves residents over WhatsApp at any hour. It takes reports, explains procedures and requirements, tells people where to go, builds the case file with the photos or PDFs the citizen sends and notifies them when their ticket moves forward. Several of its rules respond directly to what this article describes:
- It cites the law, it doesn't make things up. When the assistant talks about rights or deadlines, it cites the exact article. What is not in the sources, it does not say.
- It hands off to a person. If the citizen asks, or the case gets complicated, the conversation reaches the staff inbox, where the team sees the conversations and the follow-up on every ticket.
- Same history on web and WhatsApp. With a verified phone number, citizens pick up their report or check their tickets from either channel, without starting over.
The same criterion applies to phone calls. Agora transcribes the call and proposes a ticket filled in with the report type, address and name that were said, without inventing data that was not said. Staff review it and create it. The AI proposes; the person confirms.
And once a report becomes a ticket, every change is logged with who, when, before and after. If a citizen disputes what they were told, the institution can reconstruct the conversation and what happened next.
In Tribuna, the public safety and civic justice platform, INTELLO AI follows the same line: it helps draft the facts, suggests how to classify offenses and checks the case file for consistency before it is sent, but the decision belongs to the person.
Putting an AI assistant in front of citizens is a decision about official communication, not only about technology. Every answer it gives speaks on behalf of the institution, at any hour and to thousands of people.
The question for leadership teams is not whether the assistant answers well most of the time. It is whether, when it answers a requirement, a deadline or a right, it can point to where it got it. And whether, when it doesn't know, it says so.
If your municipality wants to serve residents over WhatsApp with answers that can be backed up, see how Agora serves citizens from start to finish, how Tribuna uses AI as support rather than as the decision, or request a demo.
- National Institute of Standards and Technology, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile (NIST AI 600-1), July 2024
- British Columbia Civil Resolution Tribunal, Moffatt v. Air Canada, 2024 BCCRT 149, February 14, 2024
- Ley Nacional para Eliminar Trámites Burocráticos (National Law to Eliminate Bureaucratic Procedures), Official Gazette of the Federation, July 16, 2025 (Chamber of Deputies, current text)