Explore, Analyse and Translate Multilingual Wikidata Properties
         
        ContribuLing 2021, 4th  June, 2021 
        John Samuel 
        CPE Lyon 
         
      
     
    
      
      
        Outline 
        
          Introduction 
          WDProp: Wikidata Property Analysis 
          Towards a coarser analysis on property translation
            
              Data Collection 
              Analysis Results 
             
           
          Conclusion and Future Works 
         
       
      
     
    
      
      
           
            Wikidata 
              
               Started in 2012 
               is free, open, linked, structured, collaborative and multilingual  knowledge base 
               From multi-(sub)domain multilingual Wikipedia sites to a single-domain multilingual website 
               
            Collaborative Multilingual Multi-domain Ontology development 
               Property proposal, discussion and voting 
               Property creation and translation Property usage 
               (Property deletion) 
               
            
            
      
     
      
     
    
      
      
        Wikidata Properties 
        
         
          Wikidata Properties 
          
         
       
      
     
    
      
      
        Wikidata Property: Labels and descriptions 
        
         
          Example Wikidata Property: country (P17) 
          
         
       
      
     
    
      
      
        Wikidata Property: Labels and descriptions 
        
         
          Example Wikidata Property: official website (P856) 
          
         
       
      
     
    
      
      
        Properties: Labels, description and aliases 
        
         
          Labels, description and aliases of Property:P31 in English 
          
         
       
      
     
    
      
      
        Wikidata Property: from Proposal to Usage 
        
         
          Property proposal and Creation 
          
         
       
      
     
    
      
      
        Wikidata Property: from Proposal to Usage 
        
         
          Property proposal, creation and usage on Wikidata 
          
         
       
      
     
    
      
      
        Wikidata Property: Translation 
        
         
          Property Creation on Wikidata 
          
         
       
      
     
    
      
      
        Wikidata Property: Missing descriptions 
        
         
          Missing multilingual descriptions on Property P31 
          
         
       
      
     
    
      
      
        Wikidata Properties: Missing descriptions 
        
         
          Missing multilingual descriptions on Property P31 
          
         
       
      
     
    
      
      
        Wikidata Properties: English 
        
         
          Wikidata (English) 
          
         
       
      
     
    
      
      
        Wikidata Properties: Afar 
        
         
          Wikidata (Afar) 
          
         
       
      
     
    
      
      
        Wikidata Properties: Missing labels 
        
         
          Missing multilingual labels on Property P31 
          
         
       
      
     
    
      
      
        WDProp 
           
            WDProp :
              
               Collaborative Multilingual Multi-domain Ontology development:
                is it possible to achieve a truly multilingual experience? 
               
            Properties :
              
               Not so much influenced by bots! 
               
            Goals :
              
               Understanding Wikidata property proposal, creation and translation 
               Available templates and their usage 
               Providing real-time statistics to (multilingual) contributors 
               
             
        
     
      
     
    
      
      
        Towards 'Everything' about Wikidata properties 
        
       
      
     
    
      
      
        Towards 'Everything' about Wikidata properties 
        
         
          Information on Wikidata Properties 
          
         
       
      
     
    
      
      
           
            WDProp 
              
               Get real-time translation statistics 
               Navigate supported languages, properties, datatypes, classes 
               Compare translation statistics 
               Find available properties for an entity 
               Shows associated Wikidata SPARQL endpoints and Mediawiki API 
               Based on basic web technologies (HTML, Javascript, CSS) 
               
            URL 
              
             
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          Wikidata languages 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          Wikidata language: Afar 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          Afar: Property labels needing translation 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          Afar: Property labels needing translation 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          Afar: Property descriptions needing translation 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          Afar: Properties missing aliases 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          English: Property labels needing translation 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          English: Property descriptions needing translation 
          
         
       
      
     
    
      
      
        Wikidata: Supported Languages 
        
         
          English: Properties missing aliases 
          
         
       
      
     
    
      
      
        Wikidata Properties 
        
         
          Wikidata properties 
          
         
       
      
     
    
      
      
        Wikidata Properties 
        
         
          Wikidata properties: All included deleted ones 
          
         
       
      
     
    
      
      
        Wikidata Properties 
        
         
          Wikidata properties: Top 100 
          
         
       
      
     
    
      
      
        Wikidata Properties 
        
         
          Wikidata Property: P856 (official website) 
          
         
       
      
     
    
      
      
        Wikidata Properties 
        
         
          Missing labels in languages: P856 
          
         
       
      
     
    
      
      
        Wikidata Properties 
        
         
          Missing descriptions in languages: P856 
          
         
       
      
     
    
      
      
        Wikidata Properties 
        
         
          Missing aliases in languages: P856 
          
         
       
      
     
    
      
      
        Wikidata Datatypes 
        
         
          Wikidata Datatypes 
          
         
       
      
     
    
      
      
        Wikidata Datatypes 
        
         
          Wikidata Datatypes: Lexemes 
          
         
       
      
     
    
      
      
        Wikidata Property Classes 
        
         
          Wikidata Property Classes 
          
         
       
      
     
    
      
      
        Wikidata Property Classes 
        
         
          Wikidata Property Classes: Lighthouse 
          
         
       
      
     
    
      
      
        Wikidata Property Classes 
        
         
          Properties for Lighthouse 
          
         
       
      
     
    
      
      
        Wikidata Property Classes 
        
         
          Properties for Lighthouse: Translation statistics 
          
         
       
      
     
    
      
      
        Wikidata Property Classes 
        
         
          Properties for Lighthouse 
          
         
       
      
     
    
      
      
        Wikidata Property Classes 
        
         
          Properties for Lighthouse 
          
         
       
      
     
    
      
      
        Wikidata Properties with References 
        
         
          Properties for Lighthouse 
          
         
       
      
     
    
      
      
        Wikidata Properties with References 
        
         
          P856: References 
          
         
       
      
     
    
      
      
        Equivalent Wikidata Properties 
        
         
          Wikidata Properties with equivalent property value 
          
         
       
      
     
    
      
      
        Wikidata Property Suggestion and Voting 
        
         
          Wikidata Property Voting: Support 
          
         
       
      
     
    
      
      
        Wikidata Property Suggestion and Voting 
        
         
          Wikidata Property Discussion 
          
         
       
      
     
    
      
      
        Wikidata Property Suggestion and Voting 
        
         
          Wikidata Property Discussion: Voting 
          
         
       
      
     
    
      
      
        Wikidata Property Suggestion and Voting 
        
         
          Wikidata Property Discussion Template 
          
         
       
      
     
    
      
      
        Wikidata Property Suggestion and Voting 
        
         
          Wikidata Property Voting: Oppose 
          
         
       
      
     
    
      
      
        Wikidata Property Suggestion and Voting 
        
         
          Wikidata Property Voting: Neutral 
          
         
       
      
     
    
      
      
        Wikidata Property Suggestion and Voting 
        
         
          Wikidata Property Voting: Comment 
          
         
       
      
     
    
      
      
        Wikiprojects 
        
         
          WikiProjects: Programming Languages 
          
         
       
      
     
    
      
      
        Wikiprojects 
        
         
          WikiProjects 
          
         
       
      
     
    
      
      
        Wikiprojects 
        
         
          WikiProjects: Properties 
          
         
       
      
     
    
      
      
        Wikiprojects 
        
         
          WikiProjects: Translation statistics for properties 
          
         
       
      
     
    
      
      
        Wikiprojects 
        
         
          WikiProjects: Museums 
          
         
       
      
     
    
      
      
        Wikidata Properties: Statistcs of Multilingual Labels 
        
         
          Real time information on number of multilingual labels 
          
         
       
      
     
    
      
      
        Wikidata Properties: Multilingual Descriptions 
        
         
          Real time information on number of multilingual descriptions 
          
         
       
      
     
    
      
      
        Wikidata Properties: Multilingual Descriptions 
        
         
          Real time information on number of multilingual aliases 
          
         
       
      
     
    
      
      
        Wikidata Properties: Comparison of Translation 
        
         
          Comparison of translation statistics 
          
         
       
      
     
    
      
      
        WDProp: Translation path 
        
         
          Wikidata properties: Translation path of three Wikidata Properties 
          
         
       
      
     
    
      
      
        WDProp: Translation path 
        
         
          Wikidata properties: Possible vandalism (removal of labels) 
          
         
       
      
     
    
      
      
        WDProp: Translation path 
        
         
          Wikidata properties: Possible vandalism (removal of labels, descriptions and aliases) 
          
         
       
      
     
    
      
      
        WDProp: Translation path 
        
         
          Wikidata properties: Visualization of Translation 
          
         
       
      
     
    
      
      
        Wikidata Properties: Revision History 
        
         
          Revision History on Wikidata: Property P17 
          
         
       
      
     
    
      
      
       Wikidata Properties: Comments from revision history 
       
        
           Attribute  
           Add  
           Update  
           Remove  
         
        
           label  
           wbsetlabel-add  
           wbsetlabel-set  
           wbsetlabel-remove 
         
        
           description  
           wbsetdescription-add  
           wbsetdescription-set  
           wbsetdescription-remove  
         
        
           alias  
           wbsetaliases-add  
           wbsetaliases-add-remove  
           wbsetaliases-remove  
         
       
       
      
    
    
      
      
       Wikidata Properties: Comments from revision history 
       
         Pros
           
             Building real-time tools 
             Easier to find what changed without looking at the content 
            
          
         Cons
           
             Multiple language changes in a single edit (bots) 
            
          
        
       
      
    
    
      
      
       Wikidata Properties: Data Collection 
       
         Wikidata MediaWiki API
           
             Make use of content parameter from 'revision history' 
             Find what actually changed between two different versions 
            
          
         Data Columns
           
             timestamp 
             property 
             language 
             type 
            
          
        
       
      
    
    
      
      
       Wikidata Properties: Data Collection 
       
        timestamp property language type 2013-10-26T16:45:20Z P999 en label 2013-10-26T16:45:20Z P999 en description 2013-10-26T18:16:05Z P999 de label 2013-10-27T02:55:15Z P999 pt label 2013-10-27T02:55:18Z P999 fr label 2013-10-28T12:42:28Z P999 pl label 2013-10-29T08:41:45Z P999 fr description 
       
      
    
    
      
      
       Wikidata Properties: Analysis Results 
        
         
          Histogram on the distribution of number of languages for different properties 
          
         
       
      
    
    
      
      
       Wikidata Properties: Analysis Results 
        
          
            Measure 
            Value 
           
          
            count 
            6347 
           
          
            mean
             21.444935 
           
          
            std 
            20.897675 
           
          
            min 
            1.000000 
           
          
            max 
            154.000000 
           
        
       
      
    
    
      
      
       Analysis Results: Frequent itemsets 
       
         Count  Language Combinations  6347  en  6338  ar  6306  nl  6263  uk  5928  fr  4823  ca  4019  de 
       
      
    
    
      
      
       Analysis Results: Frequent itemsets 
       
         Count  Language Combinations 6259  ar, uk  5923  fr, ar  5905  fr, uk  4819  ar, ca  4795  ca, uk  4530  fr, ca  4015  ar, de 
       
      
    
    
      
      
       Analysis Results: Frequent itemsets 
       
         Count  Language Combinations  6257  en, nl, ar, uk  5919  en, nl, fr, ar  5903  en, nl, fr, uk  5901  en, ar, fr, uk  5899  nl, fr, uk, ar  4818  en, nl, ar, ca  4794  en, nl, ca, uk 
       
      
    
   
      
      
        Wikipedia Infobox Properties 
        
         
          Existing English Wikipedia Infobox Properties of Programming Languages 
          
         
       
      
     
    
      
      
        Wikipedia to Wikdiata 
        
         
          Importing structured data from Wikipedia Infoboxes to Wikidata 
          
         
       
      
     
    
      
      
        Wikdiata to Wikipedia 
        
         
          Exporting data from Wikidata to multiple multilingual Wikipedia articles 
          
         
       
      
     
    
      
      
        Future Works 
           
            Search :
              
               Improving the search experience 
               
            Visualize :
              
            Download :
              
               API 
               Download as JSON, CSV 
               
             
        
     
      
     
    
      
      
           
            Contribute 
              
               Translation 
               Documentation 
               Development 
               
            URL 
              
             
       
      
     
    
      
      
        
          
           
	    Chamard, Thibaut, and John Samuel. Multilingual Wikidata Property Translation Flow Dataset. Zenodo, 8 July 2019. DOI.org (Datacite), doi:10.5281/ZENODO.3271357. 
            Kaffee, L. A., Piscopo, A., Vougiouklis, P., Simperl, E., Carr, L., & Pintscher, L. (2017, August). A glimpse into Babel: an analysis of multilinguality in Wikidata. In Proceedings of the 13th International Symposium on Open Collaboration (p. 14). ACM. 
            Müller-Birn, C., Karran, B., Lehmann, J., & Luczak-Rösch, M. (2015, August). Peer-production system or collaborative ontology engineering effort: What is Wikidata?. In Proceedings of the 11th International Symposium on Open Collaboration (p. 20). ACM. 
            Pellissier Tanon, T., & Kaffee, L. A. (2018, April). Property label stability in Wikidata: evolution and convergence of schemas in collaborative knowledge bases. In Companion of the The Web Conference 2018 on The Web Conference 2018 (pp. 1801-1803). International World Wide Web Conferences Steering Committee. 
	    
           
          
      
      
     
    
      
      
        
          
           
            Samoilenko, A., Karimi, F., Kunegis, J., Edler, D., & Strohmaier, M. (2015, June). Linguistic influence patterns within the global network of Wikipedia language editions. In Proceedings of the ACM Web Science Conference (p. 54). ACM. 
            Samuel, J. (2017) Collaborative Approach to Developing a Multilingual Ontology: A Case Study of Wikidata. In : Research Conference on Metadata and Semantics Research. Springer, Cham, 2017. p. 167-172. 
            Samuel, J. (2018). Towards Understanding and Improving Multilingual Collaborative Ontology Development in Wikidata. In: WikiWorkshop 2018 
	    Samuel, John. Johnsamuelwrites/Wdprop: V0.12. v0.12, Zenodo, 2021. DOI.org (Datacite), doi:10.5281/ZENODO.1174371. 
            Stefaner, M., Taraborelli, D., & Ciampaglia, G. L. (2011). Notabilia–Visualizing Deletion Discussions on Wikipedia.