wtf_wikipedia

#### 9.0.1 - **[fix]** - runtime error in cli (thanks maxlath!) - **[fix]** - linter fixes for regexes - update deps #### 9.0.0 Tldr: - `.templates()` now return Template objects, instead of json. - cool new http library for `.fetch()` - custom templates recieve pre-parsed json - more development of plugins detail: - **[breaking]** - .templates() now returns Template objects, like other methods (call .json()) - **[breaking]** - change interpretation of reversed params in .fetch() method (thanks wouter!) - **[breaking]** - change params for custom templates - **[breaking]** - move .random() and .category() to plugin-api - **[breaking]** - always return an array for plural methods, even with number param, like .links(3) - **[possibly-breaking]** - cleanup null|undefined responses from methods - **[possibly-breaking]** - remove .dates() method (prev deprecated) - **[possibly-breaking]** - require node 10, ie > 11 - **[change]** - normalize table rows - **[change]** - move wiktionary templates to `wtf-plugin-wiktionary` - **[change]** - Link.text() now returns page - **[change]** - improvements to 'soft' `isDisambiguation` detection - **[change]** - deprecate wtf-plugin-category (move to wtf-plugin-api) - **[new]** - api plugin - **[new]** - disambig plugin - **[new]** - person plugin - **[new]** - Table.get() method - **[new]** - set new infoboxes using .extend() - plugin-api 0.1.0 - plugin-classify 1.0.0 - plugin-disambig 0.0.1 - plugin-image 0.3.0 - plugin-person 0.2.0 - plugin-summary 0.3.0 - plugin-wikitext 1.1.0 - plugin-wikinews 0.0.1 - plugin-wikivoyage 0.0.1 - plugin-wiktionary 0.0.1 #### 8.5.1 - fix reference json encoding for mongodb #### 8.5.0 - fix for cross-domain 3rd-party wikis - improved support for fetching non-wikipedia domains #### 8.4.0 - new `wikidata()` method - new `domain()` method - support image urls from 3rd-party wikis - support for some html formatting tags \#374 - support for sub and sup templates - [fix] for link-parsing bug \#375 ### 8.3.0 - adds some wikivoyage templates - fix cli help options - change covid template again ### 8.2.0 - export http lib for plugin in `.extend()` - stop exporting (huge) mapfile in builds - deprecate `.dates()` from sentence class (didn't work) - stop ignoring `ref-list` template, keep otherwise empty `==References==` sections ### 8.1.2 - another fix for covid templates ### 8.1.1 - fix for covid templates ### 8.1.0 - [major] fix Link json object in `.json()` result - [major] fix inconsistent response for singular method aliases like `.template('foo')` - [major] change in rowspan behaviour to support covid table - support `<noinclude>` - add `.url()` and `.language()` methods - - support setters on Link methods - - add `Link.href()` method - - support proper urls for interwiki links - replicate wikipedia behaviour for apostrophe-s after link - new plugins **summary**, **classify**, **category**, and **i18n**. - Link hrefs are not titlecased anymore by default ### 8.0.0 - [breaking] move `.html()`, `.latex()`, and `.markdown()` to [their](https://github.com/spencermountain/wtf-plugin-html) [respective](https://github.com/spencermountain/wtf-plugin-latex) [plugins](https://github.com/spencermountain/wtf-plugin-markdown) - - drop header/footer boilerplate from outputs - [breaking] `.templates()` and `.links()` return Template and Link objects, and not bare JSON (use `.map(l=> l.json())`) - [breaking] refactor inputs for `.fetch()` - - no longer support 'enwikiquote' etc format as input - - use 'wiki' instead of undocumented 'wikiUrl' param - - no more automatic throttling/rate-limiting - [breaking] remove `Image.exists()` method to [plugin](./plugins/image-exists.js) - [major] create seperate client/server-side build formats (use native fetch/node lib) - [major] support deep (infinite) recursion in templates - [major] much-stronger i18n support - no-longer automatically titlecase links - support adding template parsers through plugins in `.extend()` - - support array, number, and string shorthand for template parsers - deprecate `.plaintext()` in favour of `.text()` ### 7.8.0 - add `.extend()` method for authoring plugins ### 7.7.2 - bugfixes by suntala ### 7.6.0 - use rollup for builds, publish esm module ### 7.3.0 - more unicode support ### 7.2.10 - improved unicode support for sentence/paragraph splitting - supporting more formatting templates, like **Mono** - more flexible reference support in `.json()` ### 7.2.9 - few more sports templates, - rowspan parsing fix - no-longer include package.json in builds - use full template-parser for image captions - support manually setting doc.title() ### 7.2.0 - improved date templates, bugfixes ### 7.1.1 - support population, weatherbox templates ### 7.1.0 - some template fixes - add a 'number' field in sentence json, when it looks like a number - slight change in coordinate result format, support inline coordinate text - handle fetching a large list of titles in sequence ## 7.0.0 🚨 - change result-format in a lot of templates, for more consistency. - - notably: **reference** format, **see also**, **IPA**, **main** - support colspan/rowspan in tables (a little!) - support implicit first-row headers for some tables - return templates even if they have no data - begin support for some well-used `{{foo start}}...{{foo end}}` templates - remove empty `[]` for some more section properties in `.json()` response ### 6.3.0 - support way (+20%?) more templates. ### 6.2.0 - support categories in redirects - add mongo-encoding from dumpster-dive ### 6.1.0 - titlecase internal link destinations #192 ## 6.0.0 🚨 - support `.paragraphs()` - :warning: major changes to output of `.json()`. cleaning-up redundant data.:warning: - - remove top-level `templates` data (found in `section`) - resume it with `{templates:true}` - - remove top-level `coordinates` data (found in `templates`) - resume it with `{coordinates:true}` - - remove top-level `citations` data (found in `section`) - resume it with `{citations:true}` - return empty arrays in `.json()` again ¯\_(:/)\_ /¯ - remove `h1` title on html output - change ambiguous `options.title` for sections to `options.headers` - support lists of 1 - begin removing empty references section by default - begin support for rendering citations at the bottom of documents - begin first-class references-parsing as objects at paragraph-level - use this: `.citations()` --> `.citations().map(c => c.json());` - remove `.wikitext()` and `.reparse()` methods - keeping wikitext stateful caused too many issues - turn `Image.file` into a function - include `interwiki()` results in `.links()` - support `follow_redirects` option to fetch - hide object data in console.logs - move ALL image urls from `upload.wikimedia.org/wikipedia/commons` to `wikipedia.org/wiki/Special:Redirect/file/` via 86 - image captions are now Sentence objects - rename citation → reference internally, and in json output - remove references inside section titles ### 5.3.0 - add infobox html back into html output (tentative) - redirect support in .json(), .html() output - remove empty `[]` properties in .json() results (saves disk space!) - keep `#` anchor data in .links() - show links default-on in latex output, like in md and html - render html/latex/json 'soft redirect', instead of blank pages ### 5.2.0 - make `.json()` results return proper json for tables ### 5.1.0 - improved support for gallery tag - more support for wiktionary grammar templates - tweak some regexes ## 5.0.0 - new `Table` class and `List` classes - improved table-parser - generate name `col1` instead of `col-0` - support `options.verbose_template` for debugging - support recursive tables ### 4.6.0 - `<gallery>` tag support in `.images()` - support pageids again in .fetch() - better disambiguation-page detection in english - remove wikitext from caption titles - support 3-level templates (whew!) ### 4.5.0 - support `section(0).wikitext()` - support inline {{marriage}} template - dangling semi-colons in first-sentence parentheses ### 4.2.2 - support dollar templates ## 4.2.0 - return a result or undefined for `sentences.bolds(0)`, and the like ## 4.1.0 - remove repeated/redundant text in `.links()` results - don't automatically titlecase link srcs anymore ## 4.0.0 - 🚨 non-api changing, but large result-format change - add `.wikitext()` method to Document, Section, Sentence (thanks @niebert) - move infobox, citation parser/data to Section class - `.templates()` are now an ordered array, instead of an object, and include infoboxes and citations - add (early) support for 'generic' key-value template parsing - normalize/lowercase template/infobox properties - add loose `.get('key')` method to Infobox class - mess-around with citation-template formatting - beginning to support unknown template forms - move `date` data from Sentence to Section object. - rollback of awkward+undocumented `options` param in parser (but keep options param for output methods) - add support for about a hundred new templates - templates, including citations, try to be flat-text, and no-longer return Sentence objects ## 3.1.0 - improved .json() results - guess a page's title based on bold formatting in first sentence - make section.title a function ## 3.0.0 - BIG API RE-WRITE! - move `.parse()` to main `wtf()` method - allow repeated processes without a pre-parse of the document - wtf.fetch() uses promises, and native `fetch()` method (when available) - allow per-section images, lists, tables + templates - section depth values now start at 0 - infobox values now return sentence objects - latex output (thanks @niebert!) - refactor shell scripts to `wtf_wikipedia Toronto --plaintext` - use babel-preset-env cause it's new-new - update deps ## 2.6.1 - better html output tables/infoboxes ## 2.6.0 - support for markdown output - support for html output - add page 'title' to response, where possible. - better support for capturing the `[[link]]'s` syntax - opt-out of citation, infobox, image ... parsing - support a whack of date/time/age templates ## 2.5.0 - co-ordinate parsing fix - support longer ref tags - smarter disambiguation for interwiki links vs pages containing ':' - more support for various list syntaxes ## 2.2.0 - support for {{coords}} geo-coordinate parsing+conversion - early-support for custom template-parsing ## 2.1.0 - support table '! row' row heading syntax, and other forms ## 2.0.0 - move possibly-repeatable data into the `sections` object, list 'lists' and 'tables' - change library export name to `wtf` - turn `infobox` into 'infoboxes' array - moved 'infobox_template' to infobox.type - change initial depth to 0 - change 'translations' property to 'interwiki' - support {{main}} and {{wide image|}} templates ## 1.0.0 - make `sections` into an ordered array, instead of an es6 Map thing. - add 'depth' too