This question almost always arrives around minute ten of the first meeting, right after the one about money — and it deserves a better answer than "it depends". Our earlier piece on the real cost of running an LLM on-premise answered the money half with numbers. This one answers the time half, the way a project schedule should actually be read: phase by phase with an exit criterion for each, who on the client side has to show up when, which deadlines the law has already fixed and nobody can negotiate, and which variables really decide whether you land at the start or the end of that range. We deliberately do not give one number that applies to every company — because that number, wherever it is offered, is almost certainly invented. Every technical and legal fact below was checked on 05/08/2026 and is cited in place.
In short
- The typical range: the plan Namtech publishes is five phases, 8–10 weeks in total — assessment and design 1–2 weeks, infrastructure and model deployment 2 weeks, knowledge ingestion and tuning 2 weeks, integration and testing 1–2 weeks, go-live and handover 1 week.
- The bottleneck is not on the technical side: of the five phases, only one sits entirely with the vendor. The other four each wait on a decision or a document from the client.
- The client needs at least four roles: problem owner, domain expert, document custodian, systems administrator — and three of those four do not sit in the IT department.
- The hardest legal deadline is 60 days: the personal data processing impact assessment dossier must be filed with the specialised authority within 60 days of the first day personal data is processed — which falls during knowledge ingestion, not on go-live day.
- A number you can actually measure: the weights for a 70-billion-parameter model come to 141.11 GB; over a 100 Mbps link used at full capacity, downloading that alone takes more than three hours.
- The licensing trap: "open model" does not mean "use it freely" — one Qwen release is explicitly non-commercial, one Mistral release is research-only. Hand the shortlist of models to legal in phase 01, not phase 04.
- Calibrate your expectations: according to Stanford's AI Index 2026, even among organisations with revenue above USD 5 billion, only 10% report AI that is fully scaled, while 31% are still piloting.
- 8–10 weeks — the typical total for the five-phase rollout plan Namtech publishes on its home page.
- 60 days — the deadline to file the personal data processing impact assessment dossier, counted from the first day of processing (Law No. 91/2025/QH15, Article 21.1); the same 60 days applies to the cross-border data transfer dossier (Article 20.2).
- 15 days — the period within which the specialised authority returns its assessment of the dossier (Decree 356/2025/ND-CP, Article 19.5).
- 72 hours — the deadline to notify a detected personal data protection violation (Law No. 91/2025/QH15, Article 23.1).
- 01/01/2026 — the date Vietnam's Personal Data Protection Law took effect, and the same date Decree 13/2023/ND-CP ceased to be in force (Decree 356/2025/ND-CP, Article 42.2).
- 141.11 GB — the weight files you must download for Llama-3.3-70B-Instruct, spread across 30 files (official Hugging Face repository API, checked 05/08/2026).
- 100 million monthly active users — the threshold in the Qwen2.5-72B licence above which you must request a separate licence; the equivalent Llama threshold is 700 million.
- 10% — the share of organisations with revenue above USD 5 billion reporting fully scaled AI, per AI Index 2026 (Stanford HAI, citing a McKinsey survey run June–July 2025 with 1,993 respondents across 105 nations).
Why nobody can answer "how long" on the first call
Because the time an in-house AI system takes has almost nothing to do with installing software — it depends on how fast the client makes decisions and how fast the client tidies up its documents, and no vendor knows either of those before opening the document store and looking.
This is the biggest difference between an in-house AI project and an ordinary software project. For a sales management system, scope lives in features: list the screens, estimate the effort, produce a schedule. For in-house AI, the software is only the shell; the substance is the company's own documents — procedures, contract templates, internal guidance, minutes, past quotations. With the identical package, a company whose documents sit tidily on one file server finishes noticeably earlier than a company whose documents are scattered across five places with half of them photographed on paper.
Which is why the only trustworthy figure a vendor should offer before an assessment is a range, plus the list of things that decide where in that range you land. Namtech publishes that range openly on its home page: a five-phase rollout, typically 8–10 weeks in total, depending on document volume and depth of integration. This article unpacks each phase along an axis that roadmap tables usually skip: at each phase, who the client must assign and what they must prepare — because that is where schedules slip.
The money question already has its own article: the real cost of running an LLM on-premise works through VRAM, electricity and the break-even point against renting an API. This piece is the other half of the same decision.
The 8–10 week plan: five phases and what counts as done
Five phases — assessment and design, infrastructure and model deployment, knowledge ingestion and tuning, integration and testing, go-live and handover — each with its own acceptance criterion, and the next phase does not start until the previous one meets it.
The exit criterion is what keeps a schedule from drifting. An in-house AI project falls very easily into a state of being "almost done" for weeks: the model runs, the answers look reasonable, but nobody dares declare it acceptable because nobody ever agreed what acceptable means. The only way to block that is to fix the acceptance criteria in phase 01, before a single line of configuration exists.
The table below reads the published plan along a two-sided responsibility axis. The duration column comes straight from the plan Namtech publishes; the other two columns are how we split the roles on projects we have run.
| Phase | Duration | Vendor does | Client must do | Done when |
|---|---|---|---|---|
| 01. Assessment & design | 1–2 weeks | Interview departments, draft the architecture, fix scope and acceptance criteria | Assign someone who can decide scope; open the document store for the assessment; state security constraints clearly | A written scope plus the sample question set used for acceptance, signed by both sides |
| 02. Infrastructure & model deployment | 2 weeks | Install, set up the platform, load the model, build the operating environment | Provide space, power and internal networking; grant network access; approve the model licence | The system answers general questions and generation speed is measurable |
| 03. Knowledge ingestion & tuning | 2 weeks | Process documents, build the retrieval index, tune answer quality | Hand over a filtered document set; assign a domain expert to mark each answer right or wrong | The sample question set clears the threshold agreed in phase 01 |
| 04. Integration & testing | 1–2 weeks | Wire up single sign-on, build permissions, run acceptance testing with the client | Assign a systems administrator to open SSO; fix the per-department permission map; put real users into testing | Real users log in with company accounts and see only their own slice of the data |
| 05. Go-live, training & handover | 1 week | Switch to production operation, train users, hand over documentation | Schedule training per group; nominate who takes over operations | Every group has been trained and an internal owner has signed the handover |
| Total: 8–10 weeks per the published plan — provided the client-side milestones in the fourth column are met on time. However far that column slips, the total slips with it. | ||||
Read that table and something slightly counter-intuitive appears: of the five phases, only phase 02 sits almost entirely with the vendor. The other four all have an entry in the fourth column, and each of those is a point where the project can stop and wait. This is why an honest answer to "how long" always carries a second clause: "if your side does these things on time".
Phase 0: the work that must finish before the clock starts
Before week one there is a stretch of time that appears on no roadmap — the gap between wanting to do this and deciding to do it — and for many organisations that gap is longer than all five phases put together.
Phase 0 has three tasks, and all three are purely internal. The first is appointing a problem owner: someone with the authority to say "the scope is this, not that", and to say it in the meeting rather than after a week of consultation. In-house AI projects blow their schedules less often because the engineering is hard than because every scoping question has to climb three layers of approval.
The second is choosing a first problem narrow enough to measure. "An AI assistant for the whole company" is not a scope, it is an aspiration. "Answer questions about the procurement process and standard contract terms, for procurement and legal" is a scope — because you can build a sample question set from it and mark the answers. We unpacked starting narrow and widening later in the overview of building your own in-house AI.
The third is deciding who may see what, at diagram level, before any configuration. An internal document retrieval system without permissions becomes the fastest information leak in the organisation: salaries, contracts and HR records all live in the same document store. That diagram is not the vendor's job — it is a governance decision, and we describe the common models in per-department AI permissions.
None of these three costs money or requires technical expertise. But if you enter phase 01 without them, phase 01 expands to do them for you — and that is how an eight-week plan becomes a four-month project.
Who the client has to assign — and why one missing role slips the schedule
An in-house AI project at mid-market scale needs four roles from the client, and three of the four do not belong to the IT department.
This is where many organisations go wrong from the start: hand the whole project to IT, then act surprised when the system answers fluently and gets the business wrong. IT can stand up the infrastructure and open the login, but nobody in IT knows how many mandatory clauses a company sales contract carries, or which month's version of the spending approval procedure is current. The four roles below are the minimum.
| Role | Usually held by | Needed in phase | Involvement (estimate) | Without this role |
|---|---|---|---|---|
| Problem owner | Head of the requesting function, or a member of the executive team | 0, 01, 05 | A handful of meetings, but with authority to decide on the spot | Scope drifts; every small change waits on an outer approval loop |
| Domain expert | Someone with long experience in exactly the area of the first problem | 01, 03, 04 | Heaviest in phase 03 — has to sit and mark each answer | Nobody can tell a correct answer from one that merely sounds correct |
| Document custodian | Administration, records, or the file system administrator | 0, 03 | Concentrated in gathering and filtering documents | Documents arrive incomplete, superseded, or late |
| Systems administrator | Internal IT or an outsourced IT partner | 02, 04 | Space, power, network, SSO, internal network routes | The system is built but nobody can log in with a company account |
The most demanding role, and the most consistently underestimated, is the domain expert in phase 03. Their job is not "try it out and see" but to sit and mark: this one is right, this one is wrong here, this one is right but omits a material clause. Without a marker, phase 03 has no exit criterion and the project enters the indefinite "almost done" state described above. If the organisation cannot free that person for two continuous weeks, the correct response is to stretch phase 03 and say so in the schedule, not to pretend it is still two weeks.
Documents: where projects stall longest
Of the five phases, knowledge ingestion is the only one whose duration depends almost entirely on the state your data is already in — and the only one a vendor cannot shorten on your behalf.
Documents come in four states, and the processing effort between them differs enormously. The easiest state is digitally native, structured, currently in force, and stored in one place: gathering and indexing is nearly direct. The second is digital but scattered across shared folders, mailboxes and individual cloud drives; the extra work here is gathering and de-duplicating, and de-duplication is a job only insiders can do because it requires knowing which copy is current.
The third state is documents photographed or scanned into images. This is where real time goes: the machine has to recognise characters before it can understand anything. Open-source tools handle this, including Vietnamese — Tesseract states it recognises "more than 100 languages out of the box", and the project's official training data repository ships a vie.traineddata file. But the tools' own documentation is blunt about the limits: the Marker project lists under known limitations that "Very complex layouts, with nested tables and forms, may not work". That is precisely the shape of most Vietnamese corporate paperwork: contracts with tabular annexes, minutes with signature blocks, invoices scanned crooked.
There is a licensing detail here that trips people up. The same Marker project states its code is Apache 2.0 but its model weights are not: "Our model weights use a modified AI Pubs Open Rail-M license (free for research, personal use, and startups under $5M funding/revenue)". A company above that threshold has to buy a licence — a conversation that costs time if you only discover it after the system is running. Alternatives exist: Docling is MIT-licensed and describes itself as offering "Local execution capabilities for sensitive data and air-gapped environments", which is exactly the in-house context.
The fourth state, the hardest, is knowledge that was never written down — the kind that lives in a few people's heads. No tool extracts it; someone has to interview and write it up, and that is the client's work. It is also the only item in the document phase that more budget cannot shorten.
Hardware and model: the only part you can estimate by arithmetic
Across the whole project, infrastructure and model is the one area where duration can be estimated by calculation rather than by experience — because every variable in it is a published number: the size of the weights you must download, the platform requirements of the serving stack, and the licence terms that have to clear legal.
Start with the easiest variable: downloading the model weights. This is an exact figure, not an estimate. Summing the .safetensors files in the official Hugging Face repositories gives: Mistral-7B-Instruct-v0.3 at 14.50 GB, Qwen3-32B at 65.52 GB, and Llama-3.3-70B-Instruct at 141.11 GB spread over 30 files. At the far end, DeepSeek-R1 comes to 688.59 GB across 163 files. Over a 100 Mbps link used at full capacity, downloading the 70-billion-parameter weights alone takes over three hours; the largest set on that list takes more than fifteen. This is the kind of time that adding people does not shorten, and the reason the download should start on day one of phase 02 rather than when it is first needed.
The second variable is the memory needed to run it. NVIDIA's documentation gives the formula directly: "A good heuristic formula for per-GPU weight memory is: weight_memory_per_gpu = total_parameters x bytes_per_parameter / TP" — parameters times bytes per parameter, divided across the GPUs running in parallel, where BF16 and FP16 are 2 bytes, FP8 is 1 byte and INT4 is 0.5 bytes. The same page warns that this is not the whole story: "Beyond weights, GPU memory is also needed for KV cache, activations, communication buffers, and CUDA graphs." We worked the arithmetic through in the real cost of running an LLM on-premise; the scheduling consequence here is simply that the hardware configuration has to be fixed before you can order it, and procurement lead time is a variable outside both parties' control.
The third variable rarely makes it onto a schedule but blocks at exactly the wrong moment: the platform requirements of the serving software. Two common choices demand very different infrastructure. The vLLM installation documentation requires Linux, Python 3.10–3.13 and a GPU with compute capability 7.5 or above, and states plainly that "vLLM does not support Windows natively". Ollama, by contrast, accepts substantially older hardware: "Ollama supports Nvidia GPUs with compute capability 5.0+ and driver version 550 and newer". The gap between 5.0 and 7.5 is the boundary between "use the machines you have" and "buy new ones" — and buying new ones puts your schedule in a distributor's hands. Going the packaged NVIDIA route makes the requirements more specific still: NVIDIA NIM's prerequisites page lists Ubuntu 22.04 LTS or later, CUDA SDK 12.9 or later, GPU driver 580 or later and Docker 24.0 or later.
Namtech takes a different route here — the whole platform runs on Apple Silicon installed in the client's office, in three configurations by scale — so procurement and installation are lighter than the GPU server path. But the principle is identical on any platform: model size drives configuration, configuration drives procurement time, and those two should not be scheduled back to back.
| Model | Parameters | Download size | Download time at 100 Mbps (derived) | Licence | What legal has to handle |
|---|---|---|---|---|---|
| Mistral-7B-Instruct-v0.3 | 7.25 billion | 14.50 GB | ~19 minutes | Apache-2.0 | No additional conditions |
| Llama-3.1-8B-Instruct | 8.03 billion | 16.06 GB | ~21 minutes | Meta Llama Community License | Above 700 million monthly active users you must request a licence from Meta; mandatory "Built with Llama" attribution; the repository is gated, so access must be requested first |
| Qwen3-32B | 32.76 billion | 65.52 GB | ~1 hour 27 minutes | Apache-2.0 | No additional conditions — but note that other Qwen releases are not under the same licence |
| Llama-3.3-70B-Instruct | 70.55 billion | 141.11 GB (30 files) | ~3 hours 08 minutes | Meta Llama Community License | As above, plus the obligation to retain a "Notice" file when redistributing |
| DeepSeek-R1 | 684.53 billion per the API; the model card states 671B | 688.59 GB (163 files) | ~15 hours 18 minutes | MIT | No additional conditions |
The last column is the one that gets forgotten until legal asks, at which point the project stops and waits. Open model licences are not one uniform thing. Llama 3.3 carries additional commercial terms: above 700 million monthly active users you must request a separate licence from Meta, alongside an obligation to "prominently display "Built with Llama"" on a website or in product documentation. No Vietnamese company will reach that user threshold — but the display obligation does apply, and legal needs to know before go-live rather than after.
Qwen is more complicated because the licence differs by release. Qwen3-32B ships under plain Apache-2.0, with no user threshold and no attribution requirement. But Qwen2.5-72B-Instruct uses a bespoke licence whose threshold is seven times lower than Llama's: "If you are commercially using the Materials, and your product or service has more than 100 million monthly active users, you shall request a license from us", plus an obligation to display "Built with Qwen". The smaller release is the dangerous one: Qwen2.5-3B-Instruct sits under a research licence which defines ""Non-Commercial" shall mean for research or evaluation purposes only" — meaning commercial use is not permitted. "Qwen is Apache 2.0" is a false statement, and the kind of false statement that only surfaces when legal reads carefully, typically in go-live week.
The same trap exists on the tooling side. Mistral's models fall into three groups: releases such as Mistral-7B and Mixtral-8x7B are Apache-2.0, but Mistral-Large-Instruct-2407 sits under the research licence MRL 0.1, which states "You shall only use the Mistral Models, Derivatives … and Outputs for Research Purposes" and explicitly excludes employees using it in their daily work. The short version: hand the shortlist of candidate models to legal in phase 01, not phase 04. It costs a few days early and a few weeks late.
The deadlines you cannot negotiate
This is the only item in the project whose deadline is set by law rather than agreed between the parties — and its clock starts on the first day the system processes personal data, not on go-live day.
The legal framework has changed completely in two years. The Personal Data Protection Law No. 91/2025/QH15 was passed by the 15th National Assembly on 26 June 2025, and Article 38.1 states: "Luật này có hiệu lực thi hành từ ngày 01 tháng 01 năm 2026" — this Law takes effect from 1 January 2026. On the same date, Decree 356/2025/ND-CP providing implementation detail also took effect, and it is that decree which retires the document many legal teams still treat as their handbook. Its Article 42.2 reads: "Nghị định số 13/2023/NĐ-CP ngày 17 tháng 4 năm 2023 của Chính phủ về bảo vệ dữ liệu cá nhân hết hiệu lực kể từ ngày Nghị định này có hiệu lực thi hành" — Decree 13/2023 ceases to be in force from the day this Decree takes effect. If your internal procedures still cite Decree 13, they cite a document no longer in force.
The number that matters most for an in-house AI project is 60 days. Article 21.1 of the Law requires the data controller to prepare a personal data processing impact assessment dossier and "gửi 01 bản chính cho cơ quan chuyên trách bảo vệ dữ liệu cá nhân trong thời gian 60 ngày kể từ ngày đầu tiên xử lý dữ liệu cá nhân" — send one original to the specialised personal data protection authority within 60 days of the first day of processing. Note where the count starts: the first day of processing. For an in-house AI system that falls during knowledge ingestion — roughly week five of the plan — not on launch day. Decree 356 adds the filing mechanics and forms 02a/02b, and its Article 19.5 gives the authority "thời hạn 15 ngày" to return its assessment. The dossier also has to be maintained: Article 22.1 requires it to be updated "định kỳ 06 tháng khi có sự thay đổi" — every six months when something changes.
The second deadline matters even more, because it reaches directly into the technology choice. Article 20.2 sets the same 60 days for the cross-border personal data transfer impact assessment dossier. And the Law's definition of a cross-border transfer includes "sử dụng nền tảng ở ngoài lãnh thổ … để xử lý dữ liệu cá nhân được thu thập tại Việt Nam" — using a platform outside the territory to process personal data collected in Vietnam. In other words: an AI assistant that calls out to a model service hosted abroad in order to process documents collected domestically falls squarely into this category. An incomplete dossier gets 30 days to be completed under Decree 356, with the warning that failure to do so leads the authority to "xem xét áp dụng các quy định về xử phạt vi phạm hành chính" — consider applying administrative penalties. This is precisely why many organisations keep the entire processing loop onshore; we covered that argument in AI sovereignty and in Copilot in-country and data sovereignty.
The third is 72 hours for breach notification. Article 23.1 requires a controller that detects a potentially damaging violation to notify the specialised authority "chậm nhất là 72 giờ kể từ khi phát hiện hành vi vi phạm" — no later than 72 hours after detection. That number does not affect the rollout schedule, but it dictates something inside the rollout scope: the system must keep logs detailed enough to answer, within 72 hours, who accessed what. Those logs have to be designed in, not patched on.
The second legal layer concerns AI itself. The Artificial Intelligence Law No. 134/2025/QH15, passed on 10 December 2025, states in Article 34 that it takes effect on 1 March 2026; Decree 142/2026/ND-CP implementing it took effect on 1 May 2026 — we summarised its risk classification scheme in Decree 142/2026 on AI. The scheduling-relevant part sits in Article 35 of the Law: AI systems already operating before 1 March 2026 get a transition window to comply — "18 tháng" for AI systems in healthcare, education and finance, and "12 tháng" for everything else.
One escape hatch worth knowing for smaller companies: Article 38.2 of the Personal Data Protection Law lets "doanh nghiệp nhỏ, doanh nghiệp khởi nghiệp" — small enterprises and start-ups — choose whether to apply the obligations in Articles 21 and 22 for five years from the Law's effective date, unless the company provides personal data processing services, processes sensitive personal data, or processes data on a large number of subjects. Decree 356 quantifies "large number" in Article 41: "từ 100 nghìn chủ thể dữ liệu cá nhân trở lên" — 100,000 data subjects or more on a cumulative basis. This question should be answered in phase 01, because the answer decides whether a parallel compliance track is needed at all.
| Obligation | Deadline | Counted from | Basis | Effect on the rollout schedule |
|---|---|---|---|---|
| File the personal data processing impact assessment dossier | 60 days | The first day personal data is processed | Law 91/2025/QH15, Art. 21.1; Decree 356/2025/ND-CP, Art. 19.4 | The clock starts in phase 03, not at go-live — preparation must run in parallel |
| Authority returns its assessment of the dossier | 15 days | Date of filing | Decree 356/2025/ND-CP, Art. 19.5 | Waiting time outside either party's control |
| File the cross-border data transfer impact assessment dossier | 60 days; incomplete dossiers get 30 days to be completed | The first day data is transferred out of the territory | Law 91/2025/QH15, Art. 20.2; Decree 356, Art. 18.4 and 18.6 | Applies when a platform outside the territory processes data collected in Vietnam |
| Update the impact assessment dossier | Every 6 months | Whenever something changes | Law 91/2025/QH15, Art. 22.1 | An ongoing obligation after go-live; must be assigned to whoever takes over operations |
| Notify a personal data protection violation | 72 hours | Detection of the violation | Law 91/2025/QH15, Art. 23.1 | Requires detailed access logging designed in from the start |
| Preliminary report on a serious AI system incident | 72 hours (urgent) or 5 working days; formal report a further 15 days later | Confirmation of the incident | Decree 142/2026/ND-CP, Art. 17.3 and 17.4 | An incident process with a named owner must exist before go-live |
| AI systems running before 1 March 2026 must comply with the AI Law | 12 months (general) · 18 months (healthcare, education, finance) | Effective date of Law 134/2025/QH15 (1 March 2026) | Law 134/2025/QH15, Art. 35.1 | Deadlines fall on (derived) 1 March 2027 and 1 September 2027 — newly built systems comply from day one, with no transition window |
Read this table next to Table 1 and it becomes clear why compliance should not be scheduled last. Start the dossier in go-live week and the 60-day clock has already been running for weeks, because the first day of processing happened back in knowledge ingestion. Start a parallel compliance track in phase 01 and most of what the dossier needs — the categories of data processed, the purpose, the retention period, who may access it — is exactly what you had to decide anyway to build the permission model. Do it once, use it twice.
Note: the above summarises deadlines written into legislation and is not legal advice. Applying them to a specific company requires a lawyer or an in-house legal function.
Acceptance and go-live: when is it actually done
An in-house AI system is done when real users log in with company accounts, ask the questions from the sample set fixed back in phase 01, and the pass rate clears the threshold both sides agreed — not when the system runs.
Those three words, "sample question set", are the entire difference between a project that ends on time and one that drags. The set has to be built in phase 01, by the domain expert, and it has to be frozen — if new questions keep arriving while you work, the finish line recedes at exactly the speed you approach it. A practical structure splits it into three groups: direct lookups whose answer is in the documents, questions requiring synthesis across several documents, and questions with no answer in the corpus at all. The third group tests whether the system will say "I don't have this information", and it is usually the sharpest divider between a usable system and a dangerous one.
The passing threshold should be a number, not a feeling, and should be set separately per group. Machine-side scoring has ready-made open-source tooling, and what makes it valuable for an in-house system is that it runs locally: DeepEval describes itself as a framework "similar to Pytest but specialized for unit testing LLM apps", with metrics that run "locally on your machine" — including four aimed specifically at document retrieval systems: answer relevancy, faithfulness, contextual recall and contextual precision. At the academic layer, EleutherAI's lm-evaluation-harness advertises "over 60 standard academic benchmarks for LLMs, with hundreds of subtasks and variants implemented". But to be blunt: those academic suites compare models against each other; they do not substitute for your own business question set. We covered scoring, building the evaluation set and reducing hallucination separately in building your own in-house AI: evaluation.
One more question tends to land at exactly this point and has a strong ability to stretch the schedule: "do we need to retrain the model on our data?" The default answer should be no, at least on the first pass. Microsoft's comparison of the two approaches recommends retrieval augmentation when content changes often, when coverage across many topics matters, and when resources are constrained — "Limited resources: Go with RAG if you don't have lots of data or compute for training, and the base model already does a good job". The same document lists the challenges of fine-tuning, among them "Maintenance and updating: You need to update fine-tuned models as your domain changes" — meaning every internal process change costs another training round. OpenAI says much the same in its accuracy optimisation guide: "many of our largest customer deployments at OpenAI were done using only prompt engineering and RAG".
A note on go-live: it is not the day the project ends but the day the most human-intensive part begins — changing habits. One training session and then silence almost always ends with staff drifting back to the old way within a few weeks. Post-go-live operations, including monitoring, document refresh and handling wrong answers, are described in building your own in-house AI: operations.
Build or buy: measured in time, not money
On the cost axis, building it yourself is almost always cheaper in cash out; on the time axis the reverse holds, and the gap sits in the work that only costs time once if you have done it before — choosing the model, building the index, handling permissions, building the evaluation set.
Before comparing, calibrate expectations with a public data point. Stanford HAI's AI Index 2026, citing a McKinsey survey run from 25 June to 29 July 2025 with 1,993 respondents across 105 nations, measured AI deployment stage against company revenue. The result: among organisations with revenue below USD 100 million, only 5% said their AI programme was "fully scaled"; among those above USD 5 billion the figure was still only 10%, while 31% were still piloting. The report notes that larger companies were the most likely to reach a scaling phase "given the resource and investment demands of integration". Put differently: money and scale do not solve this by themselves — the difficulty is carrying a system all the way, not standing up a prototype. We unpacked that bridge from pilot to production separately in from pilot to production.
Namtech publishes a whole series of do-it-yourself guides — hardware, choosing a model, serving, integration — and we do not retract a word of them. An engineering team with spare capacity and the motivation to learn can absolutely build this. The question is not "can it be done" but "how long will it take, and who does their day job meanwhile".
| Item | Build it yourself | Hire a rollout | Why the gap |
|---|---|---|---|
| Choosing the model and hardware configuration | You test several models against your own documents | Settled during the assessment phase | Someone who has done it repeatedly knows which model suits which document type |
| Building the retrieval index | Trial-and-error rounds on chunking and result ranking | An existing template, adjusted to your documents | Most of the DIY time goes into repeated attempts, not into writing code |
| Per-department permissions | You design permission filtering inside retrieval yourself | An existing permission model, mapped onto the client's diagram | This is the easiest thing to get wrong, and the consequence is an internal data leak |
| Quality evaluation set | Usually skipped until an incident forces it | Built in phase 01 because it is the acceptance condition | Without an evaluation set there is no finish line |
| Knowledge retained in the organisation | Highest — your team understands every layer | Depends on handover quality and documentation | This is the genuine advantage of building it yourself, and the reason to insist on written handover |
| Schedule risk | High — depends on the spare time of people with other jobs | Lower — a committed schedule and a single accountable contact | This, rather than technical capability, is the real difference |
The most practical choice is not one or the other but a split at a milestone: hire to get from zero to a working system with an evaluation set, then take the handover and run it yourself from there. The condition for that to work is that the handover must be written — system diagram, document refresh procedure, evaluation question set, and who to call when something breaks. A vendor unwilling to hand those over is telling you something worth listening to.
Six variables that decide where in the 8–10 weeks you land
The six items below, not model size or machine specification, are what actually decide whether an in-house AI project finishes on time.
This is also the list to bring into the assessment meeting and score yourself against beforehand. For each row the question is "which state are we in" — and every answer that falls in the right-hand column is a reason the range shifts towards its far end.
| Variable | Fast state | Slow state | How to shorten it |
|---|---|---|---|
| Decision authority | One person can settle scope in the meeting | Every change passes three approval layers | Name a problem owner before the assessment, with authority in writing |
| Document state | Digitally native, centralised, superseded versions removed | Scattered, many scans, old and current mixed | Start gathering and marking validity in phase 0 |
| Business marker | One fixed person throughout phase 03 | Whoever is free that day, a different person each time | Book fixed time for one person and count it in their objectives |
| Login infrastructure | SSO already in place, a responsive administrator | No SSO, or an outsourced IT partner who replies slowly | Check whether SSO can be opened in phase 01, not phase 04 |
| Integration scope | Document retrieval only | Wired into ERP/CRM with write-back | Split integration into a later phase and go live with retrieval first |
| Data compliance dossier | Someone already owns personal data protection | Nobody owns it, starting from scratch | Start it in parallel with phase 01, not at go-live |
The last row deserves one more emphasis. Many teams treat compliance paperwork as something to do after the system runs — when it is the only item on the list with a deadline set by law, non-negotiable, and impossible to shorten by adding people. Run it in parallel from day one and it never sits on the critical path; leave it to the end and it becomes the critical path.
The time an in-house AI rollout takes is not decided by how fast software installs, but by three things on the client side: who has authority to fix scope, what state the documents are in, and whether anyone will sit and mark each answer right or wrong — which is why the 8–10 week range only holds when all three are ready before week one begins.
Frequently asked questions
How long does an in-house AI rollout take?
Per the plan Namtech publishes, the typical total is 8–10 weeks across five phases: assessment and design 1–2 weeks, infrastructure and model deployment 2 weeks, knowledge ingestion and tuning 2 weeks, integration and testing 1–2 weeks, go-live and handover 1 week. That range assumes the client-side milestones — assigning people, delivering documents, opening login — are met on time. There is also a phase 0 that appears on no roadmap: the internal time a company needs to name a problem owner, fix the first scope and sketch the permission map.
How many people does the client have to assign?
At least four roles: a problem owner who can settle scope on the spot, a domain expert who marks each answer right or wrong during knowledge ingestion, a document custodian who gathers and filters the corpus, and a systems administrator for space, power, network and single sign-on. Three of those four do not sit in IT. The most demanding is the domain expert — if that person cannot be freed continuously, the ingestion phase should be stretched in the schedule rather than assumed to still be two weeks.
What if most of our documents are scans?
They are still usable, but you must add a character recognition step and a step to check the recognition results. Open-source tools handle this, Vietnamese included — Tesseract states it recognises more than 100 languages out of the box, and the project's official data repository ships a Vietnamese training file. The limits come from the tools' own documentation: the Marker project notes that very complex layouts with nested tables and forms may not work, which is exactly the shape of a contract with tabular annexes or minutes with signature blocks. In practice, split the corpus into two streams: digitally native material goes in first so a system exists early, scans are processed in parallel and added later. Check tool licensing too: some tools are Apache 2.0 in code but attach a revenue threshold to the model weights, above which commercial use requires a paid licence.
Can it be shortened below eight weeks?
Yes, by narrowing scope rather than adding people. Concretely: pick a single department for the first problem, use only the digitally native portion of the documents, defer ERP or CRM integration to a later phase, and finish the three phase 0 tasks before signing. Conversely, adding people to a late project rarely helps, because the bottleneck is on the client side — the number of marking sessions and the speed of document gathering — not the number of engineering hours.
We already use ChatGPT or Copilot — do we have to stop before moving to in-house AI?
No. The two can run in parallel, and during testing running them in parallel is the best available comparison: put the same business question to both and let the domain expert mark them. Narrowing the old tool should only follow once the sample question set clears the agreed threshold. The point to keep in view while comparing is that the two differ in where the data sits, not only in answer quality — and under Vietnamese law, processing domestically collected personal data on a platform outside the territory falls within the cross-border transfer regime with its own dossier obligation.
Is building it ourselves faster than hiring a rollout?
Usually slower, though cheaper in cash out. The reason is not technical capability but the trial-and-error rounds in work that only costs time once if you have done it before: picking a model that suits your document type, chunking documents so retrieval returns the right passage, filtering permissions inside retrieval, and building an evaluation set. In exchange, building it yourself keeps the knowledge inside the organisation. A common compromise is to hire up to the milestone of a working system with an evaluation set, then take a written handover and operate it yourself.
Does the data compliance work slow the project down?
Only if you leave it to the end. Under Personal Data Protection Law No. 91/2025/QH15, effective 1 January 2026, the personal data processing impact assessment dossier must be filed with the specialised authority within 60 days of the first day of processing — and that first day falls during knowledge ingestion, not on go-live day. The authority then has 15 days to return its assessment. So the right move is to start a parallel compliance track from the assessment phase: identify which categories of personal data the system will process, for what purpose, retained how long, accessible by whom. Most of that overlaps with what you must decide anyway to build the permission model, so it is one piece of work serving two purposes. This is a summary of the legislation, not legal advice.
Want to know whether your company lands at the start or the end of the 8–10 weeks?
Namtech starts with a free assessment: we look at the state of your document store, define a first problem narrow enough to measure, sketch the permission map, and return a written rollout schedule with acceptance criteria per phase — before you commit to anything.
Book a free assessmentNote: this article draws on public sources, checked on 05/08/2026. The five-phase durations and the 8–10 week total are the rollout plan Namtech publishes on its own home page, not an industry standard. Tables 1, 2, 5 and 6 are Namtech recommendations and estimates drawn from delivery experience — they carry no external source and should not be read as survey data. The "download time" column in Table 3 is derived by division from the real file sizes over a 100 Mbps link used at full capacity; real-world times are always longer. The dates 1 March 2027 and 1 September 2027 in Table 4 are derived by addition from the 1 March 2026 effective date and are not dates written in the texts. Quoted passages are verbatim from Vietnamese legislation, from official documentation by NVIDIA, vLLM, Ollama, Meta, Alibaba Cloud (Qwen), Mistral AI, Microsoft and OpenAI, from the named open-source projects, and from Stanford HAI's AI Index 2026; English renderings of the Vietnamese legal text are Namtech's. The legal section summarises legislation and is not legal advice — applying it to a specific company requires a lawyer or an in-house legal function. Photographs are from Pexels under the Pexels License — lead image and share image: Tima Miroshnichenko.
- Personal Data Protection Law No. 91/2025/QH15 (passed by the 15th National Assembly on 26 June 2025) — Ministry of Public Security legal document database, effective date 01/01/2026. Art. 38.1: "Luật này có hiệu lực thi hành từ ngày 01 tháng 01 năm 2026."; Art. 21.1: "…gửi 01 bản chính cho cơ quan chuyên trách bảo vệ dữ liệu cá nhân trong thời gian 60 ngày kể từ ngày đầu tiên xử lý dữ liệu cá nhân"; Art. 20.2: the same 60 days for the cross-border transfer dossier; Art. 22.1: "cập nhật định kỳ 06 tháng khi có sự thay đổi"; Art. 23.1: "chậm nhất là 72 giờ kể từ khi phát hiện hành vi vi phạm"; Art. 38.2: a five-year option for small enterprises and start-ups
- Decree 356/2025/ND-CP of 31 December 2025 detailing the Personal Data Protection Law, effective 01/01/2026 (Government legal document portal) — Art. 42.2: "Nghị định số 13/2023/NĐ-CP ngày 17 tháng 4 năm 2023 của Chính phủ về bảo vệ dữ liệu cá nhân hết hiệu lực kể từ ngày Nghị định này có hiệu lực thi hành."; Art. 19.5: assessment returned "trong thời hạn 15 ngày"; Art. 18.6: 30 days to complete an incomplete dossier; Art. 41.1: the threshold "từ 100 nghìn chủ thể dữ liệu cá nhân trở lên"
- Decree 356/2025/ND-CP — full 71-page digitally signed PDF on the Government legal document repository (2,357,540 bytes, retrieved 05/08/2026)
- Artificial Intelligence Law No. 134/2025/QH15 (passed 10 December 2025) — PDF on the Government legal document repository. Art. 34: "Luật này có hiệu lực thi hành từ ngày 01 tháng 3 năm 2026"; Art. 35.1: "18 tháng … đối với hệ thống trí tuệ nhân tạo trong lĩnh vực y tế, giáo dục và tài chính" and "12 tháng … đối với các hệ thống trí tuệ nhân tạo không thuộc trường hợp quy định tại điểm a"
- Decree 142/2026/ND-CP of 30 April 2026 detailing the Artificial Intelligence Law, effective 01/5/2026 (Government legal document portal) — Art. 17.3.a: "báo cáo sơ bộ trong thời hạn 72 giờ kể từ thời điểm xác nhận sự cố"; Art. 17.3.b: "05 ngày làm việc"; Art. 17.4: formal report "trong thời hạn 15 ngày kể từ ngày nộp báo cáo sơ bộ"
- Hugging Face API — official repository meta-llama/Llama-3.3-70B-Instruct (retrieved 05/08/2026): 70,553,706,496 parameters, 141,107,497,872 bytes of .safetensors across 30 files; the repository is gated, so raw file access returns 401 without approval
- Hugging Face API — Qwen/Qwen3-32B (retrieved 05/08/2026): 32,762,123,264 parameters, 65,524,328,560 bytes across 17 .safetensors files
- Hugging Face API — mistralai/Mistral-7B-Instruct-v0.3 (retrieved 05/08/2026): 7,248,023,552 parameters; the Hugging Face-format shard set is 14,496,080,928 bytes (the repository also holds a second copy of the same weights in Mistral format, not added together)
- Hugging Face API — deepseek-ai/DeepSeek-R1 (retrieved 05/08/2026): 688,586,727,753 bytes across 163 files; the API reports 684,531,386,000 parameters while the project's own model card states 671B — two figures from the same publisher that do not reconcile, so both are given
- NVIDIA NIM for LLMs — memory troubleshooting: "A good heuristic formula for per-GPU weight memory is: weight_memory_per_gpu = total_parameters x bytes_per_parameter / TP"; "Beyond weights, GPU memory is also needed for KV cache, activations, communication buffers, and CUDA graphs."
- NVIDIA NIM for LLMs — prerequisites: Ubuntu 22.04 LTS or later recommended · Container Toolkit 1.14.0 or later · CUDA SDK 12.9 or later · GPU Driver 580 or later · Docker 24.0 or later. "Different models require different minimum amounts of GPU memory. For example, Llama 3.1 8B Instruct requires a minimum of 24GB of GPU memory."
- vLLM v0.26.0 — GPU installation documentation (the source the docs site is built from): "OS: Linux", "Python: 3.10 -- 3.13", "vLLM does not support Windows natively"; the included file states "GPU: compute capability 7.5 or higher"
- Ollama — GPU documentation: "Ollama supports Nvidia GPUs with compute capability 5.0+ and driver version 550 and newer."
- Meta — Llama 3.3 Community License (official meta-llama/llama-models repository): "…is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta"; "prominently display "Built with Llama" on a related website, user interface, blogpost, about page, or product documentation"
- Qwen3-32B — LICENSE file in the official repository: "Apache License, Version 2.0, January 2004"
- Qwen2.5-72B-Instruct — "Qwen LICENSE AGREEMENT, Release Date: September 19, 2024": "If you are commercially using the Materials, and your product or service has more than 100 million monthly active users, you shall request a license from us."; "…you shall prominently display "Built with Qwen" or "Improved using Qwen" in the related product documentation."
- Qwen2.5-3B-Instruct — "Qwen RESEARCH LICENSE AGREEMENT": ""Non-Commercial" shall mean for research or evaluation purposes only."; "If you are commercially using the Materials, you shall request a license from us."
- Mistral AI — Mistral Research License 0.1 (covering Mistral-Large-Instruct-2407): "3.2. Usage Limitation. You shall only use the Mistral Models, Derivatives … and Outputs for Research Purposes."
- Tesseract OCR — official repository README: "Tesseract has unicode (UTF-8) support, and can recognize more than 100 languages "out of the box"." The official tessdata repository ships vie.traineddata (129 .traineddata files, checked 05/08/2026)
- Marker — official repository README: "Very complex layouts, with nested tables and forms, may not work"; "Our code is licensed under Apache 2.0 … Our model weights use a modified AI Pubs Open Rail-M license (free for research, personal use, and startups under $5M funding/revenue)."
- Docling — official repository README (MIT licence): "Local execution capabilities for sensitive data and air-gapped environments"; "Extensive OCR support for scanned PDFs and images"
- DeepEval — official repository README: "It is similar to Pytest but specialized for unit testing LLM apps… which uses LLM-as-a-judge and other NLP models that run locally on your machine."
- EleutherAI lm-evaluation-harness — README: "Over 60 standard academic benchmarks for LLMs, with hundreds of subtasks and variants implemented."
- Microsoft Learn — "Augment large language models with retrieval-augmented generation or fine-tuning": "Limited resources: Go with RAG if you don't have lots of data or compute for training, and the base model already does a good job."; "Maintenance and updating: You need to update fine-tuned models as your domain changes."
- OpenAI — "Optimizing LLM Accuracy": "RAG is an incredibly valuable tool for increasing the accuracy and consistency of an LLM - many of our largest customer deployments at OpenAI were done using only prompt engineering and RAG."
- Stanford HAI — AI Index Report 2026, Figure 4.3.6 "Stage of AI deployment by organization revenue, 2025" (data source: McKinsey & Company Survey, 2025): organisations below USD 100M revenue report 5% "Fully scaled"; those above USD 5B report 10% "Fully scaled" and 31% still "Piloting". Methodology (Appendix): the online survey ran from 25 June 2025 to 29 July 2025 and "garnered responses from 1,993 participants in 105 nations"