Explore, Analyse and Translate Multilingual Wikidata Properties
ContribuLing 2021, 4th June, 2021
John Samuel
CPE Lyon
Outline
Introduction
WDProp: Wikidata Property Analysis
Towards a coarser analysis on property translation
Data Collection
Analysis Results
Conclusion and Future Works
Wikidata
Started in 2012
is free, open, linked, structured, collaborative and multilingual knowledge base
From multi-(sub)domain multilingual Wikipedia sites to a single-domain multilingual website
Collaborative Multilingual Multi-domain Ontology development
Property proposal, discussion and voting
Property creation and translation
Property usage
(Property deletion)
Wikidata Properties
Wikidata Properties
Wikidata Property: Labels and descriptions
Example Wikidata Property: country (P17)
Wikidata Property: Labels and descriptions
Example Wikidata Property: official website (P856)
Properties: Labels, description and aliases
Labels, description and aliases of Property:P31 in English
Wikidata Property: from Proposal to Usage
Property proposal and Creation
Wikidata Property: from Proposal to Usage
Property proposal, creation and usage on Wikidata
Wikidata Property: Translation
Property Creation on Wikidata
Wikidata Property: Missing descriptions
Missing multilingual descriptions on Property P31
Wikidata Properties: Missing descriptions
Missing multilingual descriptions on Property P31
Wikidata Properties: English
Wikidata (English)
Wikidata Properties: Afar
Wikidata (Afar)
Wikidata Properties: Missing labels
Missing multilingual labels on Property P31
WDProp
WDProp :
Collaborative Multilingual Multi-domain Ontology development:
is it possible to achieve a truly multilingual experience?
Properties :
Not so much influenced by bots!
Goals :
Understanding Wikidata property proposal, creation and translation
Available templates and their usage
Providing real-time statistics to (multilingual) contributors
Towards 'Everything' about Wikidata properties
Towards 'Everything' about Wikidata properties
Information on Wikidata Properties
WDProp
Get real-time translation statistics
Navigate supported languages, properties, datatypes, classes
Compare translation statistics
Find available properties for an entity
Shows associated Wikidata SPARQL endpoints and Mediawiki API
Based on basic web technologies (HTML, Javascript, CSS)
URL
Wikidata: Supported Languages
Wikidata languages
Wikidata: Supported Languages
Wikidata language: Afar
Wikidata: Supported Languages
Afar: Property labels needing translation
Wikidata: Supported Languages
Afar: Property labels needing translation
Wikidata: Supported Languages
Afar: Property descriptions needing translation
Wikidata: Supported Languages
Afar: Properties missing aliases
Wikidata: Supported Languages
English: Property labels needing translation
Wikidata: Supported Languages
English: Property descriptions needing translation
Wikidata: Supported Languages
English: Properties missing aliases
Wikidata Properties
Wikidata properties
Wikidata Properties
Wikidata properties: All included deleted ones
Wikidata Properties
Wikidata properties: Top 100
Wikidata Properties
Wikidata Property: P856 (official website)
Wikidata Properties
Missing labels in languages: P856
Wikidata Properties
Missing descriptions in languages: P856
Wikidata Properties
Missing aliases in languages: P856
Wikidata Datatypes
Wikidata Datatypes
Wikidata Datatypes
Wikidata Datatypes: Lexemes
Wikidata Property Classes
Wikidata Property Classes
Wikidata Property Classes
Wikidata Property Classes: Lighthouse
Wikidata Property Classes
Properties for Lighthouse
Wikidata Property Classes
Properties for Lighthouse: Translation statistics
Wikidata Property Classes
Properties for Lighthouse
Wikidata Property Classes
Properties for Lighthouse
Wikidata Properties with References
Properties for Lighthouse
Wikidata Properties with References
P856: References
Equivalent Wikidata Properties
Wikidata Properties with equivalent property value
Wikidata Property Suggestion and Voting
Wikidata Property Voting: Support
Wikidata Property Suggestion and Voting
Wikidata Property Discussion
Wikidata Property Suggestion and Voting
Wikidata Property Discussion: Voting
Wikidata Property Suggestion and Voting
Wikidata Property Discussion Template
Wikidata Property Suggestion and Voting
Wikidata Property Voting: Oppose
Wikidata Property Suggestion and Voting
Wikidata Property Voting: Neutral
Wikidata Property Suggestion and Voting
Wikidata Property Voting: Comment
Wikiprojects
WikiProjects: Programming Languages
Wikiprojects
WikiProjects
Wikiprojects
WikiProjects: Properties
Wikiprojects
WikiProjects: Translation statistics for properties
Wikiprojects
WikiProjects: Museums
Wikidata Properties: Statistcs of Multilingual Labels
Real time information on number of multilingual labels
Wikidata Properties: Multilingual Descriptions
Real time information on number of multilingual descriptions
Wikidata Properties: Multilingual Descriptions
Real time information on number of multilingual aliases
Wikidata Properties: Comparison of Translation
Comparison of translation statistics
WDProp: Translation path
Wikidata properties: Translation path of three Wikidata Properties
WDProp: Translation path
Wikidata properties: Possible vandalism (removal of labels)
WDProp: Translation path
Wikidata properties: Possible vandalism (removal of labels, descriptions and aliases)
WDProp: Translation path
Wikidata properties: Visualization of Translation
Wikidata Properties: Revision History
Revision History on Wikidata: Property P17
Wikidata Properties: Comments from revision history
Attribute
Add
Update
Remove
label
wbsetlabel-add
wbsetlabel-set
wbsetlabel-remove
description
wbsetdescription-add
wbsetdescription-set
wbsetdescription-remove
alias
wbsetaliases-add
wbsetaliases-add-remove
wbsetaliases-remove
Wikidata Properties: Comments from revision history
Pros
Building real-time tools
Easier to find what changed without looking at the content
Cons
Multiple language changes in a single edit (bots)
Wikidata Properties: Data Collection
Wikidata MediaWiki API
Make use of content parameter from 'revision history'
Find what actually changed between two different versions
Data Columns
timestamp
property
language
type
Wikidata Properties: Data Collection
timestamp property language type
2013-10-26T16:45:20Z P999 en label
2013-10-26T16:45:20Z P999 en description
2013-10-26T18:16:05Z P999 de label
2013-10-27T02:55:15Z P999 pt label
2013-10-27T02:55:18Z P999 fr label
2013-10-28T12:42:28Z P999 pl label
2013-10-29T08:41:45Z P999 fr description
Wikidata Properties: Analysis Results
Histogram on the distribution of number of languages for different properties
Wikidata Properties: Analysis Results
Measure
Value
count
6347
mean
21.444935
std
20.897675
min
1.000000
max
154.000000
Analysis Results: Frequent itemsets
Count Language Combinations
6347 en
6338 ar
6306 nl
6263 uk
5928 fr
4823 ca
4019 de
Analysis Results: Frequent itemsets
Count Language Combinations
6259 ar, uk
5923 fr, ar
5905 fr, uk
4819 ar, ca
4795 ca, uk
4530 fr, ca
4015 ar, de
Analysis Results: Frequent itemsets
Count Language Combinations
6257 en, nl, ar, uk
5919 en, nl, fr, ar
5903 en, nl, fr, uk
5901 en, ar, fr, uk
5899 nl, fr, uk, ar
4818 en, nl, ar, ca
4794 en, nl, ca, uk
Wikipedia Infobox Properties
Existing English Wikipedia Infobox Properties of Programming Languages
Wikipedia to Wikdiata
Importing structured data from Wikipedia Infoboxes to Wikidata
Wikdiata to Wikipedia
Exporting data from Wikidata to multiple multilingual Wikipedia articles
Future Works
Search :
Improving the search experience
Visualize :
Download :
API
Download as JSON, CSV
Contribute
Translation
Documentation
Development
URL
Chamard, Thibaut, and John Samuel. Multilingual Wikidata Property Translation Flow Dataset. Zenodo, 8 July 2019. DOI.org (Datacite), doi:10.5281/ZENODO.3271357.
Kaffee, L. A., Piscopo, A., Vougiouklis, P., Simperl, E., Carr, L., & Pintscher, L. (2017, August). A glimpse into Babel: an analysis of multilinguality in Wikidata. In Proceedings of the 13th International Symposium on Open Collaboration (p. 14). ACM.
Müller-Birn, C., Karran, B., Lehmann, J., & Luczak-Rösch, M. (2015, August). Peer-production system or collaborative ontology engineering effort: What is Wikidata?. In Proceedings of the 11th International Symposium on Open Collaboration (p. 20). ACM.
Pellissier Tanon, T., & Kaffee, L. A. (2018, April). Property label stability in Wikidata: evolution and convergence of schemas in collaborative knowledge bases. In Companion of the The Web Conference 2018 on The Web Conference 2018 (pp. 1801-1803). International World Wide Web Conferences Steering Committee.
Samoilenko, A., Karimi, F., Kunegis, J., Edler, D., & Strohmaier, M. (2015, June). Linguistic influence patterns within the global network of Wikipedia language editions. In Proceedings of the ACM Web Science Conference (p. 54). ACM.
Samuel, J. (2017) Collaborative Approach to Developing a Multilingual Ontology: A Case Study of Wikidata. In : Research Conference on Metadata and Semantics Research. Springer, Cham, 2017. p. 167-172.
Samuel, J. (2018). Towards Understanding and Improving Multilingual Collaborative Ontology Development in Wikidata. In: WikiWorkshop 2018
Samuel, John. Johnsamuelwrites/Wdprop: V0.12. v0.12, Zenodo, 2021. DOI.org (Datacite), doi:10.5281/ZENODO.1174371.
Stefaner, M., Taraborelli, D., & Ciampaglia, G. L. (2011). Notabilia–Visualizing Deletion Discussions on Wikipedia.