Using parsoid to convert wikitext to html gives Template:<template name> in output html, can I avoid that?

[srg9000]

I am trying to convert wikitext data dump of en wikipedia to html and I used "php parsoid/bin/parse.php --standalone --wt2html --inputfile <file>" to convert wikitext to html. I am separating tables but a lot of tables have Template:<template name>strings instead of the actual value. For example, all citations are converted to Template:cite. I used a container available on aws marketplace from bitnami for mediawiki and called the above mentioned command as a subprocess from inside a python script. What am I doing wrong or is that something I can do to replace that with actual values.

I have attached a sample pdf which is converted from the html (After some preprocessing and with html) the table is from https://en.wikipedia.org/wiki/Hungarian_language

Thank you

90_Hungarian language_79_1_chrome.pdf

[Skizzerz]

If you're using the wikipedia dumps, the "all pages" dump will include templates.

[Skizzerz]

You are likely missing the text of those templates (and all nested dependencies) from your input file/wiki. You may be missing some extensions as well, but that's something you'll just need to find out as you go along.

[Skizzerz]

No on-wiki content is part of any repositories or docker images. You'll need to export them from the source wiki in question and import them into your wiki.

[srg9000]

23 hours ago, Skizzerz said:

You are likely missing the text of those templates (and all nested dependencies) from your input file/wiki. You may be missing some extensions as well, but that's something you'll just need to find out as you go along.

Thank you for your response. Would you happen to know if those templates part of the mediawiki repo or docker image? A lot of them are for citations, web links etc. For this case, I used parsoid with --standalone flag, would it help if i ran it without that flag (sorry, i am not experienced in php)?

Thank you

Edited May 18, 2022 by srg9000 (see edit history)

[srg9000]

16 hours ago, Skizzerz said:

No on-wiki content is part of any repositories or docker images. You'll need to export them from the source wiki in question and import them into your wiki.

Thanks for clarifying. I am working with wikipedia data dump only, is there a separate dump for the template sources because Special:Export requires me to manually pass in every template? If I get sources of all templates, how can I add them? I am running it inside a container via ssh, so might not be able to use gui to use Special:Import to import individual pages independently
 

Thank You