Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact
Upcoming SlideShare
Loading in...5
×
 

Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact

on

  • 1,856 views

Presentation given to the Northern Alberta Health Libraries Association (NAHLA) Trends Mini Conference in Edmonton at the University of Alberta on May 2, 2014

Presentation given to the Northern Alberta Health Libraries Association (NAHLA) Trends Mini Conference in Edmonton at the University of Alberta on May 2, 2014

Statistics

Views

Total Views
1,856
Views on SlideShare
1,552
Embed Views
304

Actions

Likes
4
Downloads
31
Comments
3

6 Embeds 304

http://www.scoop.it 200
https://twitter.com 95
http://digest.sagepub.com 5
https://storify.com 2
https://www.rebelmouse.com 1
http://www.slideee.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

CC Attribution-NonCommercial LicenseCC Attribution-NonCommercial License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Thanks for the feedback! It was a challenge to distinguish all of the altmetric products. I hope I represented Impactstory accurately, but I didn't discuss Plum X (Plum Analytics) and will have to request access to test it out too. The notes for this presentation include a transcript with more details about Impactstory. For anyone interested, it is worth downloading the PowerPoint to get all the details.
    Are you sure you want to
    Your message goes here
    Processing…
  • I somehow forgot Altmetric.com in my point about gathering impacts. They're awesome, too.
    Are you sure you want to
    Your message goes here
    Processing…
  • Robin, this is awesome! I especially liked how your points about finding correlations between metrics wasn't too focused on altmetrics' corr. with citations.

    One thing to note, perhaps for future versions of this talk, is that what sets Impactstory and Plum X apart from the other altmetrics providers is that we sum up impact, gathering info from the heaps of different metrics sources like Github, Mendeley, etc.

    Again, great slide deck!
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact Presentation Transcript

  • Robin Featherstone, MLIS Research Librarian, Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta @rmfeatherstone http://www.slideshare.net/featherr Tweet your pubs: How altmetrics are changing the way we measure research impact http://www.ualberta.ca/ARCHE/ @arche4evidence Spring 2014
  • Conflict of interest disclosure • I have had free access to the Altmetric.com Explorer since September 2013
  • Image by Nik Papageorgiou: http://theupturnedmicroscope.com
  • Altmetrics… […] capture ways in which articles are disseminated throughout the expanding scholarly ecosystem, and reach beyond the scope of traditional trackers and filters. […] measure research impact by including references outside of traditional scholarly publishing. 3. Public Library of Science (PLOS). Altmetrics. [29 April 2014]. Available from http://article-level-metrics.plos.org/alt-metrics/ 4. Baynes G. Scientometrics, bibliometrics, altmetrics: Some introductory advice for the lost and bemused. Insights. 2012;25(3):311-5. doi: 10.1629/2048-7754.25.3.311.
  • Altmetric tools measure • Tweets • Blog mentions • Facebook posts • Presentations • News articles • Shared citations (e.g., Mendeley, CiteULike) • Data uploads • Etc.
  • What’s your impact1? 1. Emerald Group Publishing. Impact of Research [11 April 2014]. Available from: http://www.emeraldgrouppublishing.com/authors/impact/index.htm http://blogs.lse.ac.uk/impactofsocialsciences/2011/07/14/publishers-measuring-impact/
  • Agenda • Researcher & article case studies • Altmetric products • Measurable mentions & unique IDs • Gaming the system • Altmetric research • Altmetrics for biomedical and health sciences • Future directions
  • Researcher case study – Heather Piwowar • h-index: 8 – 23 articles cited 258 times http://www.scopus.com/authid/detail.url?authorId=25122628200
  • Researcher Case Study – Heather Piwowar • Slideshare followers: 85 http://www.slideshare.net/hpiwowar • ImpactStory research products: 117 http://impactstory.org/HeatherPiwowar • Figshare views: 1384 http://figshare.com/authors/Heather_Piwowar/96399 • GitHub contributions: 1410 https://github.com/hpiwowar • Google Scholar h-index: 13 (51 publications cited 678 times) http://scholar.google.ca/citations?user=1YLq0XMAAAAJ&hl=en • ResearchGate score: 14.33 • Research Gate Impact Points: 50.29 https://www.researchgate.net/profile/Heather_Piwowar2
  • Article Case Study – Marshall 2013 • Web of Science times cited: 1 • Google Scholar times cited: 21 • Scopus times cited: 6
  • Article Case Study – Marshall 2013 • Altmetric score: 76
  • Altmetrics Players
  • Measurable Mentions A. Great article in Oncology by Kotsori! B. Great article in Oncology by @akotsori - http://www.ncbi.nlm.nih.gov/pubmed/21430400 C. Great article in @oncologyjournal by @akotsori #breastcancer - http://1.usa.gov/1ltIu25
  • What is gaming? • Alice has a new paper out. She asks those grad students of hers who blog to write about it. • Alice has a new paper out. She believes that it contains important information for diabetes patients and so signs up to a ’100 retweets for $$$’ service. 5. Case examples from: Adie, E. Gaming Altmetrics. [29 April 2014]. Available from http://www.altmetric.com/blog/gaming-altmetrics/
  • Auto-spamming
  • Spectrum of social media self- promotion 6. Adie, E. Gaming Altmetrics. [29 April 2014]. Available from http://www.altmetric.com/blog/gaming-altmetrics/
  • Altmetrics research • PLOS Altmetrics Collection: http://www.ploscollections.org/altmetrics • Many studies compared altmetrics with citation counts and Impact Factors • Positive but weak correlations found
  • Altmetrics in the health sciences • ‘Biomedical and health sciences’ showed highest share of publications with Altmetric.com scores7 • Increasing numbers of PubMed citations were being tweeted8 2010 2.4% 2011 10.9% 2012 20.4% 7. Costas R, Zahedi Z, Wouters P. Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. arXiv preprint arXiv:14014321. 2014. 8. Haustein S, Peters I, Sugimoto CR, Thelwall M, Larivière V. Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology. 2013.
  • Social Media and health • Used for: – Health promotion9, 10 – Education11 – Communication and knowledge sharing12 9. Williams G, Hamm MP, Shulhan J, Vandermeer B, Hartling L. Social media interventions for diet and exercise behaviours: a systematic review and meta-analysis of randomised controlled trials. BMJ Open. 2014;4(2). doi: 10.1136/bmjopen-2013-003926. 10. Hamm MP, Chisholm A, Shulhan J, Milne A, Scott SD, Given LM, et al. Social media use among patients and caregivers: a scoping review. BMJ Open. 2013;3(5). doi: 10.1136/bmjopen-2013-002819. 11. Hamm MP, Klassen TP, Scott SD, Moher D, Hartling L. Education in Health Research Methodology: Use of a Wiki for Knowledge Translation. PLoS ONE. 2013;8(5):e64922. doi: 10.1371/journal.pone.0064922. 12. Hamm MP, Chisholm A, Shulhan J, Milne A, Scott SD, Klassen TP, et al. Social media use by health care professionals and trainees: a scoping review. Academic medicine : journal of the Association of American Medical Colleges. 2013;88(9):1376-83. doi: 10.1097/ACM.0b013e31829eb91c.
  • Rank Score Article Title Year Journal 1 1350 Early Television Exposure and Subsequent Attentional Problems in Children 2004 Pediatrics 2 558 Do Television and Electronic Games Predict Children’s Psychosocial Adjustment? Longitudinal Research Using the UK Millennium Cohort Study 2013 Archives of Disease in Childhood 3 521 Microbial Contamination of Human Milk Purchased via the Internet 2013 Pediatrics 4 457 Effective Messages in Vaccine Promotion: A Randomized Trial 2014 Pediatrics 5 383 Gun Violence Trends in Movies 2013 Pediatrics Using Altmetrics.com rankings – Pediatric Journals
  • Using Altmetrics.com rankings - ARCHE publications Rank Score Article Title Journal Notes 1 152 How confidence intervals become confusion intervals BMC Medical Research Methodology One of the highest ever scores in this journal (ranked #1 of 364) – article was mentioned by 219 tweeters 2 148 Lifestyle Interventions for Patients With and at Risk for Type 2 Diabetes: A Systematic Review and Meta- analysis Annals of Internal Medicine Among the highest ever scored in this journal (ranked #37 of 2470) – article was mentioned by 128 tweeters 3 122 Social media use among patients and caregivers: a scoping review BMJ Open Among the highest ever scored in this journal (ranked #22 of 1501) – article was mentioned by 150 tweeters
  • Future Directions – Publisher-driven altmetrics
  • Future Directions – Product development • Increase transparency of self-promotion activites • Implement anti-spamming/anti-gaming software solutions
  • Future Directions – Standards development
  • Future Directions – Research • Is there a correlation between altmetrics rankings and… – full-text downloads? – qualitative measures of interest? – …
  • Future Directions - Assessment • Will be used by: – funding agencies – research centres – libraries – Knowledge Translation (KT) researchers
  • Future Directions
  • The Alberta Research Centre for Health Evidence Edmonton, Alberta, Canada Robin Featherstone, MLIS @rmfeatherstone feathers@ualberta.ca Slides available: http://www.slideshare.net/featherr