In-house AI

How long does an in-house AI rollout take? The 8–10 week plan, who the client has to assign, and the six variables that decide whether you finish on time

Last updated: 05/08/2026

A bright meeting room with slatted blinds, a woman in an orange blazer standing at the right pointing at a whiteboard covered in hand-drawn distribution curves, a pie chart and sticky notes, while three colleagues sit around a table with laptops, notebooks and markers

This question almost always arrives around minute ten of the first meeting, right after the one about money — and it deserves a better answer than "it depends". Our earlier piece on the real cost of running an LLM on-premise answered the money half with numbers. This one answers the time half, the way a project schedule should actually be read: phase by phase with an exit criterion for each, who on the client side has to show up when, which deadlines the law has already fixed and nobody can negotiate, and which variables really decide whether you land at the start or the end of that range. We deliberately do not give one number that applies to every company — because that number, wherever it is offered, is almost certainly invented. Every technical and legal fact below was checked on 05/08/2026 and is cited in place.

In short

  • The typical range: the plan Namtech publishes is five phases, 8–10 weeks in total — assessment and design 1–2 weeks, infrastructure and model deployment 2 weeks, knowledge ingestion and tuning 2 weeks, integration and testing 1–2 weeks, go-live and handover 1 week.
  • The bottleneck is not on the technical side: of the five phases, only one sits entirely with the vendor. The other four each wait on a decision or a document from the client.
  • The client needs at least four roles: problem owner, domain expert, document custodian, systems administrator — and three of those four do not sit in the IT department.
  • The hardest legal deadline is 60 days: the personal data processing impact assessment dossier must be filed with the specialised authority within 60 days of the first day personal data is processed — which falls during knowledge ingestion, not on go-live day.
  • A number you can actually measure: the weights for a 70-billion-parameter model come to 141.11 GB; over a 100 Mbps link used at full capacity, downloading that alone takes more than three hours.
  • The licensing trap: "open model" does not mean "use it freely" — one Qwen release is explicitly non-commercial, one Mistral release is research-only. Hand the shortlist of models to legal in phase 01, not phase 04.
  • Calibrate your expectations: according to Stanford's AI Index 2026, even among organisations with revenue above USD 5 billion, only 10% report AI that is fully scaled, while 31% are still piloting.
Key figures (each one cited in place below and in the sources block)
  • 8–10 weeks — the typical total for the five-phase rollout plan Namtech publishes on its home page.
  • 60 days — the deadline to file the personal data processing impact assessment dossier, counted from the first day of processing (Law No. 91/2025/QH15, Article 21.1); the same 60 days applies to the cross-border data transfer dossier (Article 20.2).
  • 15 days — the period within which the specialised authority returns its assessment of the dossier (Decree 356/2025/ND-CP, Article 19.5).
  • 72 hours — the deadline to notify a detected personal data protection violation (Law No. 91/2025/QH15, Article 23.1).
  • 01/01/2026 — the date Vietnam's Personal Data Protection Law took effect, and the same date Decree 13/2023/ND-CP ceased to be in force (Decree 356/2025/ND-CP, Article 42.2).
  • 141.11 GB — the weight files you must download for Llama-3.3-70B-Instruct, spread across 30 files (official Hugging Face repository API, checked 05/08/2026).
  • 100 million monthly active users — the threshold in the Qwen2.5-72B licence above which you must request a separate licence; the equivalent Llama threshold is 700 million.
  • 10% — the share of organisations with revenue above USD 5 billion reporting fully scaled AI, per AI Index 2026 (Stanford HAI, citing a McKinsey survey run June–July 2025 with 1,993 respondents across 105 nations).

Why nobody can answer "how long" on the first call

Because the time an in-house AI system takes has almost nothing to do with installing software — it depends on how fast the client makes decisions and how fast the client tidies up its documents, and no vendor knows either of those before opening the document store and looking.

This is the biggest difference between an in-house AI project and an ordinary software project. For a sales management system, scope lives in features: list the screens, estimate the effort, produce a schedule. For in-house AI, the software is only the shell; the substance is the company's own documents — procedures, contract templates, internal guidance, minutes, past quotations. With the identical package, a company whose documents sit tidily on one file server finishes noticeably earlier than a company whose documents are scattered across five places with half of them photographed on paper.

Which is why the only trustworthy figure a vendor should offer before an assessment is a range, plus the list of things that decide where in that range you land. Namtech publishes that range openly on its home page: a five-phase rollout, typically 8–10 weeks in total, depending on document volume and depth of integration. This article unpacks each phase along an axis that roadmap tables usually skip: at each phase, who the client must assign and what they must prepare — because that is where schedules slip.

The money question already has its own article: the real cost of running an LLM on-premise works through VRAM, electricity and the break-even point against renting an API. This piece is the other half of the same decision.

The 8–10 week plan: five phases and what counts as done

Five phases — assessment and design, infrastructure and model deployment, knowledge ingestion and tuning, integration and testing, go-live and handover — each with its own acceptance criterion, and the next phase does not start until the previous one meets it.

The exit criterion is what keeps a schedule from drifting. An in-house AI project falls very easily into a state of being "almost done" for weeks: the model runs, the answers look reasonable, but nobody dares declare it acceptable because nobody ever agreed what acceptable means. The only way to block that is to fix the acceptance criteria in phase 01, before a single line of configuration exists.

The table below reads the published plan along a two-sided responsibility axis. The duration column comes straight from the plan Namtech publishes; the other two columns are how we split the roles on projects we have run.

Table 1 — Five phases of an in-house AI rollout: duration, vendor work and client work (the duration column is taken from the rollout plan Namtech publishes publicly under "Quy trình triển khai" on its home page; the two responsibility columns and the exit criterion column are Namtech recommendations, not an industry standard)
PhaseDurationVendor doesClient must doDone when
01. Assessment & design1–2 weeksInterview departments, draft the architecture, fix scope and acceptance criteriaAssign someone who can decide scope; open the document store for the assessment; state security constraints clearlyA written scope plus the sample question set used for acceptance, signed by both sides
02. Infrastructure & model deployment2 weeksInstall, set up the platform, load the model, build the operating environmentProvide space, power and internal networking; grant network access; approve the model licenceThe system answers general questions and generation speed is measurable
03. Knowledge ingestion & tuning2 weeksProcess documents, build the retrieval index, tune answer qualityHand over a filtered document set; assign a domain expert to mark each answer right or wrongThe sample question set clears the threshold agreed in phase 01
04. Integration & testing1–2 weeksWire up single sign-on, build permissions, run acceptance testing with the clientAssign a systems administrator to open SSO; fix the per-department permission map; put real users into testingReal users log in with company accounts and see only their own slice of the data
05. Go-live, training & handover1 weekSwitch to production operation, train users, hand over documentationSchedule training per group; nominate who takes over operationsEvery group has been trained and an internal owner has signed the handover
Total: 8–10 weeks per the published plan — provided the client-side milestones in the fourth column are met on time. However far that column slips, the total slips with it.

Read that table and something slightly counter-intuitive appears: of the five phases, only phase 02 sits almost entirely with the vendor. The other four all have an entry in the fourth column, and each of those is a point where the project can stop and wait. This is why an honest answer to "how long" always carries a second clause: "if your side does these things on time".

Phase 0: the work that must finish before the clock starts

Before week one there is a stretch of time that appears on no roadmap — the gap between wanting to do this and deciding to do it — and for many organisations that gap is longer than all five phases put together.

Phase 0 has three tasks, and all three are purely internal. The first is appointing a problem owner: someone with the authority to say "the scope is this, not that", and to say it in the meeting rather than after a week of consultation. In-house AI projects blow their schedules less often because the engineering is hard than because every scoping question has to climb three layers of approval.

The second is choosing a first problem narrow enough to measure. "An AI assistant for the whole company" is not a scope, it is an aspiration. "Answer questions about the procurement process and standard contract terms, for procurement and legal" is a scope — because you can build a sample question set from it and mark the answers. We unpacked starting narrow and widening later in the overview of building your own in-house AI.

The third is deciding who may see what, at diagram level, before any configuration. An internal document retrieval system without permissions becomes the fastest information leak in the organisation: salaries, contracts and HR records all live in the same document store. That diagram is not the vendor's job — it is a governance decision, and we describe the common models in per-department AI permissions.

None of these three costs money or requires technical expertise. But if you enter phase 01 without them, phase 01 expands to do them for you — and that is how an eight-week plan becomes a four-month project.

Who the client has to assign — and why one missing role slips the schedule

An in-house AI project at mid-market scale needs four roles from the client, and three of the four do not belong to the IT department.

This is where many organisations go wrong from the start: hand the whole project to IT, then act surprised when the system answers fluently and gets the business wrong. IT can stand up the infrastructure and open the login, but nobody in IT knows how many mandatory clauses a company sales contract carries, or which month's version of the spending approval procedure is current. The four roles below are the minimum.

Table 2 — Four client-side roles, when they are needed and what happens without them (this is a Namtech staffing recommendation drawn from projects we have delivered; the involvement column is an estimate, not a contractual commitment)
RoleUsually held byNeeded in phaseInvolvement (estimate)Without this role
Problem ownerHead of the requesting function, or a member of the executive team0, 01, 05A handful of meetings, but with authority to decide on the spotScope drifts; every small change waits on an outer approval loop
Domain expertSomeone with long experience in exactly the area of the first problem01, 03, 04Heaviest in phase 03 — has to sit and mark each answerNobody can tell a correct answer from one that merely sounds correct
Document custodianAdministration, records, or the file system administrator0, 03Concentrated in gathering and filtering documentsDocuments arrive incomplete, superseded, or late
Systems administratorInternal IT or an outsourced IT partner02, 04Space, power, network, SSO, internal network routesThe system is built but nobody can log in with a company account

The most demanding role, and the most consistently underestimated, is the domain expert in phase 03. Their job is not "try it out and see" but to sit and mark: this one is right, this one is wrong here, this one is right but omits a material clause. Without a marker, phase 03 has no exit criterion and the project enters the indefinite "almost done" state described above. If the organisation cannot free that person for two continuous weeks, the correct response is to stretch phase 03 and say so in the schedule, not to pretend it is still two weeks.

Documents: where projects stall longest

Of the five phases, knowledge ingestion is the only one whose duration depends almost entirely on the state your data is already in — and the only one a vendor cannot shorten on your behalf.

Documents come in four states, and the processing effort between them differs enormously. The easiest state is digitally native, structured, currently in force, and stored in one place: gathering and indexing is nearly direct. The second is digital but scattered across shared folders, mailboxes and individual cloud drives; the extra work here is gathering and de-duplicating, and de-duplication is a job only insiders can do because it requires knowing which copy is current.

The third state is documents photographed or scanned into images. This is where real time goes: the machine has to recognise characters before it can understand anything. Open-source tools handle this, including Vietnamese — Tesseract states it recognises "more than 100 languages out of the box", and the project's official training data repository ships a vie.traineddata file. But the tools' own documentation is blunt about the limits: the Marker project lists under known limitations that "Very complex layouts, with nested tables and forms, may not work". That is precisely the shape of most Vietnamese corporate paperwork: contracts with tabular annexes, minutes with signature blocks, invoices scanned crooked.

There is a licensing detail here that trips people up. The same Marker project states its code is Apache 2.0 but its model weights are not: "Our model weights use a modified AI Pubs Open Rail-M license (free for research, personal use, and startups under $5M funding/revenue)". A company above that threshold has to buy a licence — a conversation that costs time if you only discover it after the system is running. Alternatives exist: Docling is MIT-licensed and describes itself as offering "Local execution capabilities for sensitive data and air-gapped environments", which is exactly the in-house context.

The fourth state, the hardest, is knowledge that was never written down — the kind that lives in a few people's heads. No tool extracts it; someone has to interview and write it up, and that is the client's work. It is also the only item in the document phase that more budget cannot shorten.

A row of server racks shot at an angle down a white-walled machine room corridor, the nearest cabinet open to reveal a tangle of red and blue network cables and a few small red LEDs, the cabinets behind it fading into the distance behind perforated mesh doors
Infrastructure is the one phase of the five that sits almost entirely with the vendor — which is also why it is rarely where the schedule slips. Photo: Brett Sayles / Pexels (Pexels License).

Hardware and model: the only part you can estimate by arithmetic

Across the whole project, infrastructure and model is the one area where duration can be estimated by calculation rather than by experience — because every variable in it is a published number: the size of the weights you must download, the platform requirements of the serving stack, and the licence terms that have to clear legal.

Start with the easiest variable: downloading the model weights. This is an exact figure, not an estimate. Summing the .safetensors files in the official Hugging Face repositories gives: Mistral-7B-Instruct-v0.3 at 14.50 GB, Qwen3-32B at 65.52 GB, and Llama-3.3-70B-Instruct at 141.11 GB spread over 30 files. At the far end, DeepSeek-R1 comes to 688.59 GB across 163 files. Over a 100 Mbps link used at full capacity, downloading the 70-billion-parameter weights alone takes over three hours; the largest set on that list takes more than fifteen. This is the kind of time that adding people does not shorten, and the reason the download should start on day one of phase 02 rather than when it is first needed.

The second variable is the memory needed to run it. NVIDIA's documentation gives the formula directly: "A good heuristic formula for per-GPU weight memory is: weight_memory_per_gpu = total_parameters x bytes_per_parameter / TP" — parameters times bytes per parameter, divided across the GPUs running in parallel, where BF16 and FP16 are 2 bytes, FP8 is 1 byte and INT4 is 0.5 bytes. The same page warns that this is not the whole story: "Beyond weights, GPU memory is also needed for KV cache, activations, communication buffers, and CUDA graphs." We worked the arithmetic through in the real cost of running an LLM on-premise; the scheduling consequence here is simply that the hardware configuration has to be fixed before you can order it, and procurement lead time is a variable outside both parties' control.

The third variable rarely makes it onto a schedule but blocks at exactly the wrong moment: the platform requirements of the serving software. Two common choices demand very different infrastructure. The vLLM installation documentation requires Linux, Python 3.10–3.13 and a GPU with compute capability 7.5 or above, and states plainly that "vLLM does not support Windows natively". Ollama, by contrast, accepts substantially older hardware: "Ollama supports Nvidia GPUs with compute capability 5.0+ and driver version 550 and newer". The gap between 5.0 and 7.5 is the boundary between "use the machines you have" and "buy new ones" — and buying new ones puts your schedule in a distributor's hands. Going the packaged NVIDIA route makes the requirements more specific still: NVIDIA NIM's prerequisites page lists Ubuntu 22.04 LTS or later, CUDA SDK 12.9 or later, GPU driver 580 or later and Docker 24.0 or later.

Namtech takes a different route here — the whole platform runs on Apple Silicon installed in the client's office, in three configurations by scale — so procurement and installation are lighter than the GPU server path. But the principle is identical on any platform: model size drives configuration, configuration drives procurement time, and those two should not be scheduled back to back.

Table 3 — Four widely used open models: download size, download time and licence conditions (sizes and parameter counts taken directly from the official Hugging Face repository API, checked 05/08/2026, summing the .safetensors files; the download time column is (derived) from those sizes over a 100 Mbps link used at full capacity — real-world times are always longer; licence terms quoted verbatim from the official licence texts)
ModelParametersDownload sizeDownload time at 100 Mbps (derived)LicenceWhat legal has to handle
Mistral-7B-Instruct-v0.37.25 billion14.50 GB~19 minutesApache-2.0No additional conditions
Llama-3.1-8B-Instruct8.03 billion16.06 GB~21 minutesMeta Llama Community LicenseAbove 700 million monthly active users you must request a licence from Meta; mandatory "Built with Llama" attribution; the repository is gated, so access must be requested first
Qwen3-32B32.76 billion65.52 GB~1 hour 27 minutesApache-2.0No additional conditions — but note that other Qwen releases are not under the same licence
Llama-3.3-70B-Instruct70.55 billion141.11 GB (30 files)~3 hours 08 minutesMeta Llama Community LicenseAs above, plus the obligation to retain a "Notice" file when redistributing
DeepSeek-R1684.53 billion per the API; the model card states 671B688.59 GB (163 files)~15 hours 18 minutesMITNo additional conditions

The last column is the one that gets forgotten until legal asks, at which point the project stops and waits. Open model licences are not one uniform thing. Llama 3.3 carries additional commercial terms: above 700 million monthly active users you must request a separate licence from Meta, alongside an obligation to "prominently display "Built with Llama"" on a website or in product documentation. No Vietnamese company will reach that user threshold — but the display obligation does apply, and legal needs to know before go-live rather than after.

Qwen is more complicated because the licence differs by release. Qwen3-32B ships under plain Apache-2.0, with no user threshold and no attribution requirement. But Qwen2.5-72B-Instruct uses a bespoke licence whose threshold is seven times lower than Llama's: "If you are commercially using the Materials, and your product or service has more than 100 million monthly active users, you shall request a license from us", plus an obligation to display "Built with Qwen". The smaller release is the dangerous one: Qwen2.5-3B-Instruct sits under a research licence which defines ""Non-Commercial" shall mean for research or evaluation purposes only" — meaning commercial use is not permitted. "Qwen is Apache 2.0" is a false statement, and the kind of false statement that only surfaces when legal reads carefully, typically in go-live week.

The same trap exists on the tooling side. Mistral's models fall into three groups: releases such as Mistral-7B and Mixtral-8x7B are Apache-2.0, but Mistral-Large-Instruct-2407 sits under the research licence MRL 0.1, which states "You shall only use the Mistral Models, Derivatives … and Outputs for Research Purposes" and explicitly excludes employees using it in their daily work. The short version: hand the shortlist of candidate models to legal in phase 01, not phase 04. It costs a few days early and a few weeks late.

The deadlines you cannot negotiate

This is the only item in the project whose deadline is set by law rather than agreed between the parties — and its clock starts on the first day the system processes personal data, not on go-live day.

The legal framework has changed completely in two years. The Personal Data Protection Law No. 91/2025/QH15 was passed by the 15th National Assembly on 26 June 2025, and Article 38.1 states: "Luật này có hiệu lực thi hành từ ngày 01 tháng 01 năm 2026" — this Law takes effect from 1 January 2026. On the same date, Decree 356/2025/ND-CP providing implementation detail also took effect, and it is that decree which retires the document many legal teams still treat as their handbook. Its Article 42.2 reads: "Nghị định số 13/2023/NĐ-CP ngày 17 tháng 4 năm 2023 của Chính phủ về bảo vệ dữ liệu cá nhân hết hiệu lực kể từ ngày Nghị định này có hiệu lực thi hành" — Decree 13/2023 ceases to be in force from the day this Decree takes effect. If your internal procedures still cite Decree 13, they cite a document no longer in force.

The number that matters most for an in-house AI project is 60 days. Article 21.1 of the Law requires the data controller to prepare a personal data processing impact assessment dossier and "gửi 01 bản chính cho cơ quan chuyên trách bảo vệ dữ liệu cá nhân trong thời gian 60 ngày kể từ ngày đầu tiên xử lý dữ liệu cá nhân" — send one original to the specialised personal data protection authority within 60 days of the first day of processing. Note where the count starts: the first day of processing. For an in-house AI system that falls during knowledge ingestion — roughly week five of the plan — not on launch day. Decree 356 adds the filing mechanics and forms 02a/02b, and its Article 19.5 gives the authority "thời hạn 15 ngày" to return its assessment. The dossier also has to be maintained: Article 22.1 requires it to be updated "định kỳ 06 tháng khi có sự thay đổi" — every six months when something changes.

The second deadline matters even more, because it reaches directly into the technology choice. Article 20.2 sets the same 60 days for the cross-border personal data transfer impact assessment dossier. And the Law's definition of a cross-border transfer includes "sử dụng nền tảng ở ngoài lãnh thổ … để xử lý dữ liệu cá nhân được thu thập tại Việt Nam" — using a platform outside the territory to process personal data collected in Vietnam. In other words: an AI assistant that calls out to a model service hosted abroad in order to process documents collected domestically falls squarely into this category. An incomplete dossier gets 30 days to be completed under Decree 356, with the warning that failure to do so leads the authority to "xem xét áp dụng các quy định về xử phạt vi phạm hành chính" — consider applying administrative penalties. This is precisely why many organisations keep the entire processing loop onshore; we covered that argument in AI sovereignty and in Copilot in-country and data sovereignty.

The third is 72 hours for breach notification. Article 23.1 requires a controller that detects a potentially damaging violation to notify the specialised authority "chậm nhất là 72 giờ kể từ khi phát hiện hành vi vi phạm" — no later than 72 hours after detection. That number does not affect the rollout schedule, but it dictates something inside the rollout scope: the system must keep logs detailed enough to answer, within 72 hours, who accessed what. Those logs have to be designed in, not patched on.

The second legal layer concerns AI itself. The Artificial Intelligence Law No. 134/2025/QH15, passed on 10 December 2025, states in Article 34 that it takes effect on 1 March 2026; Decree 142/2026/ND-CP implementing it took effect on 1 May 2026 — we summarised its risk classification scheme in Decree 142/2026 on AI. The scheduling-relevant part sits in Article 35 of the Law: AI systems already operating before 1 March 2026 get a transition window to comply — "18 tháng" for AI systems in healthcare, education and finance, and "12 tháng" for everything else.

One escape hatch worth knowing for smaller companies: Article 38.2 of the Personal Data Protection Law lets "doanh nghiệp nhỏ, doanh nghiệp khởi nghiệp" — small enterprises and start-ups — choose whether to apply the obligations in Articles 21 and 22 for five years from the Law's effective date, unless the company provides personal data processing services, processes sensitive personal data, or processes data on a large number of subjects. Decree 356 quantifies "large number" in Article 41: "từ 100 nghìn chủ thể dữ liệu cá nhân trở lên" — 100,000 data subjects or more on a cumulative basis. This question should be answered in phase 01, because the answer decides whether a parallel compliance track is needed at all.

Table 4 — Deadlines fixed by Vietnamese law that bear directly on an in-house AI project (all figures and articles quoted verbatim from the official gazette PDFs of Law 91/2025/QH15, Decree 356/2025/ND-CP, Law 134/2025/QH15 and Decree 142/2026/ND-CP; the two dates in the last row are (derived) by addition from the 1 March 2026 effective date, not dates written in the texts)
ObligationDeadlineCounted fromBasisEffect on the rollout schedule
File the personal data processing impact assessment dossier60 daysThe first day personal data is processedLaw 91/2025/QH15, Art. 21.1; Decree 356/2025/ND-CP, Art. 19.4The clock starts in phase 03, not at go-live — preparation must run in parallel
Authority returns its assessment of the dossier15 daysDate of filingDecree 356/2025/ND-CP, Art. 19.5Waiting time outside either party's control
File the cross-border data transfer impact assessment dossier60 days; incomplete dossiers get 30 days to be completedThe first day data is transferred out of the territoryLaw 91/2025/QH15, Art. 20.2; Decree 356, Art. 18.4 and 18.6Applies when a platform outside the territory processes data collected in Vietnam
Update the impact assessment dossierEvery 6 monthsWhenever something changesLaw 91/2025/QH15, Art. 22.1An ongoing obligation after go-live; must be assigned to whoever takes over operations
Notify a personal data protection violation72 hoursDetection of the violationLaw 91/2025/QH15, Art. 23.1Requires detailed access logging designed in from the start
Preliminary report on a serious AI system incident72 hours (urgent) or 5 working days; formal report a further 15 days laterConfirmation of the incidentDecree 142/2026/ND-CP, Art. 17.3 and 17.4An incident process with a named owner must exist before go-live
AI systems running before 1 March 2026 must comply with the AI Law12 months (general) · 18 months (healthcare, education, finance)Effective date of Law 134/2025/QH15 (1 March 2026)Law 134/2025/QH15, Art. 35.1Deadlines fall on (derived) 1 March 2027 and 1 September 2027 — newly built systems comply from day one, with no transition window

Read this table next to Table 1 and it becomes clear why compliance should not be scheduled last. Start the dossier in go-live week and the 60-day clock has already been running for weeks, because the first day of processing happened back in knowledge ingestion. Start a parallel compliance track in phase 01 and most of what the dossier needs — the categories of data processed, the purpose, the retention period, who may access it — is exactly what you had to decide anyway to build the permission model. Do it once, use it twice.

Note: the above summarises deadlines written into legislation and is not legal advice. Applying them to a specific company requires a lawyer or an in-house legal function.

A high-floor open-plan office with curved glass walls overlooking a city skyline, two women sitting side by side typing on laptops at a long light-wood desk, one man leaning against a concrete column on the left and another in glasses standing on the right, with an open notebook and coloured sticky notes on the desk
Go-live is not the end of the project — it is the start of the hardest part: changing how an entire organisation works. Photo: Thirdman / Pexels (Pexels License).

Acceptance and go-live: when is it actually done

An in-house AI system is done when real users log in with company accounts, ask the questions from the sample set fixed back in phase 01, and the pass rate clears the threshold both sides agreed — not when the system runs.

Those three words, "sample question set", are the entire difference between a project that ends on time and one that drags. The set has to be built in phase 01, by the domain expert, and it has to be frozen — if new questions keep arriving while you work, the finish line recedes at exactly the speed you approach it. A practical structure splits it into three groups: direct lookups whose answer is in the documents, questions requiring synthesis across several documents, and questions with no answer in the corpus at all. The third group tests whether the system will say "I don't have this information", and it is usually the sharpest divider between a usable system and a dangerous one.

The passing threshold should be a number, not a feeling, and should be set separately per group. Machine-side scoring has ready-made open-source tooling, and what makes it valuable for an in-house system is that it runs locally: DeepEval describes itself as a framework "similar to Pytest but specialized for unit testing LLM apps", with metrics that run "locally on your machine" — including four aimed specifically at document retrieval systems: answer relevancy, faithfulness, contextual recall and contextual precision. At the academic layer, EleutherAI's lm-evaluation-harness advertises "over 60 standard academic benchmarks for LLMs, with hundreds of subtasks and variants implemented". But to be blunt: those academic suites compare models against each other; they do not substitute for your own business question set. We covered scoring, building the evaluation set and reducing hallucination separately in building your own in-house AI: evaluation.

One more question tends to land at exactly this point and has a strong ability to stretch the schedule: "do we need to retrain the model on our data?" The default answer should be no, at least on the first pass. Microsoft's comparison of the two approaches recommends retrieval augmentation when content changes often, when coverage across many topics matters, and when resources are constrained — "Limited resources: Go with RAG if you don't have lots of data or compute for training, and the base model already does a good job". The same document lists the challenges of fine-tuning, among them "Maintenance and updating: You need to update fine-tuned models as your domain changes" — meaning every internal process change costs another training round. OpenAI says much the same in its accuracy optimisation guide: "many of our largest customer deployments at OpenAI were done using only prompt engineering and RAG".

A note on go-live: it is not the day the project ends but the day the most human-intensive part begins — changing habits. One training session and then silence almost always ends with staff drifting back to the old way within a few weeks. Post-go-live operations, including monitoring, document refresh and handling wrong answers, are described in building your own in-house AI: operations.

Build or buy: measured in time, not money

On the cost axis, building it yourself is almost always cheaper in cash out; on the time axis the reverse holds, and the gap sits in the work that only costs time once if you have done it before — choosing the model, building the index, handling permissions, building the evaluation set.

Before comparing, calibrate expectations with a public data point. Stanford HAI's AI Index 2026, citing a McKinsey survey run from 25 June to 29 July 2025 with 1,993 respondents across 105 nations, measured AI deployment stage against company revenue. The result: among organisations with revenue below USD 100 million, only 5% said their AI programme was "fully scaled"; among those above USD 5 billion the figure was still only 10%, while 31% were still piloting. The report notes that larger companies were the most likely to reach a scaling phase "given the resource and investment demands of integration". Put differently: money and scale do not solve this by themselves — the difficulty is carrying a system all the way, not standing up a prototype. We unpacked that bridge from pilot to production separately in from pilot to production.

Namtech publishes a whole series of do-it-yourself guides — hardware, choosing a model, serving, integration — and we do not retract a word of them. An engineering team with spare capacity and the motivation to learn can absolutely build this. The question is not "can it be done" but "how long will it take, and who does their day job meanwhile".

Table 5 — Building it yourself versus hiring a rollout, compared on the time axis (this table is a Namtech recommendation and estimate drawn from delivery experience; it is not industry survey data and carries no external source)
ItemBuild it yourselfHire a rolloutWhy the gap
Choosing the model and hardware configurationYou test several models against your own documentsSettled during the assessment phaseSomeone who has done it repeatedly knows which model suits which document type
Building the retrieval indexTrial-and-error rounds on chunking and result rankingAn existing template, adjusted to your documentsMost of the DIY time goes into repeated attempts, not into writing code
Per-department permissionsYou design permission filtering inside retrieval yourselfAn existing permission model, mapped onto the client's diagramThis is the easiest thing to get wrong, and the consequence is an internal data leak
Quality evaluation setUsually skipped until an incident forces itBuilt in phase 01 because it is the acceptance conditionWithout an evaluation set there is no finish line
Knowledge retained in the organisationHighest — your team understands every layerDepends on handover quality and documentationThis is the genuine advantage of building it yourself, and the reason to insist on written handover
Schedule riskHigh — depends on the spare time of people with other jobsLower — a committed schedule and a single accountable contactThis, rather than technical capability, is the real difference

The most practical choice is not one or the other but a split at a milestone: hire to get from zero to a working system with an evaluation set, then take the handover and run it yourself from there. The condition for that to work is that the handover must be written — system diagram, document refresh procedure, evaluation question set, and who to call when something breaks. A vendor unwilling to hand those over is telling you something worth listening to.

Six variables that decide where in the 8–10 weeks you land

The six items below, not model size or machine specification, are what actually decide whether an in-house AI project finishes on time.

This is also the list to bring into the assessment meeting and score yourself against beforehand. For each row the question is "which state are we in" — and every answer that falls in the right-hand column is a reason the range shifts towards its far end.

Table 6 — Six variables that stretch a project and how to shorten each (a Namtech recommendation; the indicators are drawn from projects we have run, not from survey data)
VariableFast stateSlow stateHow to shorten it
Decision authorityOne person can settle scope in the meetingEvery change passes three approval layersName a problem owner before the assessment, with authority in writing
Document stateDigitally native, centralised, superseded versions removedScattered, many scans, old and current mixedStart gathering and marking validity in phase 0
Business markerOne fixed person throughout phase 03Whoever is free that day, a different person each timeBook fixed time for one person and count it in their objectives
Login infrastructureSSO already in place, a responsive administratorNo SSO, or an outsourced IT partner who replies slowlyCheck whether SSO can be opened in phase 01, not phase 04
Integration scopeDocument retrieval onlyWired into ERP/CRM with write-backSplit integration into a later phase and go live with retrieval first
Data compliance dossierSomeone already owns personal data protectionNobody owns it, starting from scratchStart it in parallel with phase 01, not at go-live

The last row deserves one more emphasis. Many teams treat compliance paperwork as something to do after the system runs — when it is the only item on the list with a deadline set by law, non-negotiable, and impossible to shorten by adding people. Run it in parallel from day one and it never sits on the critical path; leave it to the end and it becomes the critical path.

The time an in-house AI rollout takes is not decided by how fast software installs, but by three things on the client side: who has authority to fix scope, what state the documents are in, and whether anyone will sit and mark each answer right or wrong — which is why the 8–10 week range only holds when all three are ready before week one begins.

Frequently asked questions

How long does an in-house AI rollout take?

Per the plan Namtech publishes, the typical total is 8–10 weeks across five phases: assessment and design 1–2 weeks, infrastructure and model deployment 2 weeks, knowledge ingestion and tuning 2 weeks, integration and testing 1–2 weeks, go-live and handover 1 week. That range assumes the client-side milestones — assigning people, delivering documents, opening login — are met on time. There is also a phase 0 that appears on no roadmap: the internal time a company needs to name a problem owner, fix the first scope and sketch the permission map.

How many people does the client have to assign?

At least four roles: a problem owner who can settle scope on the spot, a domain expert who marks each answer right or wrong during knowledge ingestion, a document custodian who gathers and filters the corpus, and a systems administrator for space, power, network and single sign-on. Three of those four do not sit in IT. The most demanding is the domain expert — if that person cannot be freed continuously, the ingestion phase should be stretched in the schedule rather than assumed to still be two weeks.

What if most of our documents are scans?

They are still usable, but you must add a character recognition step and a step to check the recognition results. Open-source tools handle this, Vietnamese included — Tesseract states it recognises more than 100 languages out of the box, and the project's official data repository ships a Vietnamese training file. The limits come from the tools' own documentation: the Marker project notes that very complex layouts with nested tables and forms may not work, which is exactly the shape of a contract with tabular annexes or minutes with signature blocks. In practice, split the corpus into two streams: digitally native material goes in first so a system exists early, scans are processed in parallel and added later. Check tool licensing too: some tools are Apache 2.0 in code but attach a revenue threshold to the model weights, above which commercial use requires a paid licence.

Can it be shortened below eight weeks?

Yes, by narrowing scope rather than adding people. Concretely: pick a single department for the first problem, use only the digitally native portion of the documents, defer ERP or CRM integration to a later phase, and finish the three phase 0 tasks before signing. Conversely, adding people to a late project rarely helps, because the bottleneck is on the client side — the number of marking sessions and the speed of document gathering — not the number of engineering hours.

We already use ChatGPT or Copilot — do we have to stop before moving to in-house AI?

No. The two can run in parallel, and during testing running them in parallel is the best available comparison: put the same business question to both and let the domain expert mark them. Narrowing the old tool should only follow once the sample question set clears the agreed threshold. The point to keep in view while comparing is that the two differ in where the data sits, not only in answer quality — and under Vietnamese law, processing domestically collected personal data on a platform outside the territory falls within the cross-border transfer regime with its own dossier obligation.

Is building it ourselves faster than hiring a rollout?

Usually slower, though cheaper in cash out. The reason is not technical capability but the trial-and-error rounds in work that only costs time once if you have done it before: picking a model that suits your document type, chunking documents so retrieval returns the right passage, filtering permissions inside retrieval, and building an evaluation set. In exchange, building it yourself keeps the knowledge inside the organisation. A common compromise is to hire up to the milestone of a working system with an evaluation set, then take a written handover and operate it yourself.

Does the data compliance work slow the project down?

Only if you leave it to the end. Under Personal Data Protection Law No. 91/2025/QH15, effective 1 January 2026, the personal data processing impact assessment dossier must be filed with the specialised authority within 60 days of the first day of processing — and that first day falls during knowledge ingestion, not on go-live day. The authority then has 15 days to return its assessment. So the right move is to start a parallel compliance track from the assessment phase: identify which categories of personal data the system will process, for what purpose, retained how long, accessible by whom. Most of that overlaps with what you must decide anyway to build the permission model, so it is one piece of work serving two purposes. This is a summary of the legislation, not legal advice.

Want to know whether your company lands at the start or the end of the 8–10 weeks?

Namtech starts with a free assessment: we look at the state of your document store, define a first problem narrow enough to measure, sketch the permission map, and return a written rollout schedule with acceptance criteria per phase — before you commit to anything.

Book a free assessment

Note: this article draws on public sources, checked on 05/08/2026. The five-phase durations and the 8–10 week total are the rollout plan Namtech publishes on its own home page, not an industry standard. Tables 1, 2, 5 and 6 are Namtech recommendations and estimates drawn from delivery experience — they carry no external source and should not be read as survey data. The "download time" column in Table 3 is derived by division from the real file sizes over a 100 Mbps link used at full capacity; real-world times are always longer. The dates 1 March 2027 and 1 September 2027 in Table 4 are derived by addition from the 1 March 2026 effective date and are not dates written in the texts. Quoted passages are verbatim from Vietnamese legislation, from official documentation by NVIDIA, vLLM, Ollama, Meta, Alibaba Cloud (Qwen), Mistral AI, Microsoft and OpenAI, from the named open-source projects, and from Stanford HAI's AI Index 2026; English renderings of the Vietnamese legal text are Namtech's. The legal section summarises legislation and is not legal advice — applying it to a specific company requires a lawyer or an in-house legal function. Photographs are from Pexels under the Pexels License — lead image and share image: Tima Miroshnichenko.

Sources
Get started

Start with a free assessment

To determine the right package and detailed scope, Namtech offers a short assessment session at no cost.

We reply within one business day. No spam, and we never share your details.