Posts tagged peer review
“On the left you can see features of good science, with authors providing their data and software code, and in the best cases even using pre-registration of their study and version control for maximum transparency. The grey area in the middle shows questionable research practices, which can include p-hacking, sloppy statistics, peer review abuse etc. On the right side and marked ‘red’ is scientific misconduct as commonly defined (falsification, fabrication, plagiarism). Between the grey and red are is data secrecy.”
http://blogs.lse.ac.uk/impactofsocialsciences/2015/07/03/data-secrecy-bad-science-or-scientific-misconduct/
For better or worse, people imagine Facebook is run by a benevolent dictator, that the site is there to enable people to better connect with others. In some senses, this is true. But Facebook is also a company […] it designs its algorithms not just to market to you directly but to convince you to keep coming back over and over again. People have an abstract notion of how that operates, but they don’t really know, or even want to know. They just want the hot dog to taste good. Whether it’s couched as research or operations, people don’t want to think they’re being manipulated. So when they find out what soylent green is made of, they’re outraged. This study isn’t really what’s at stake. What’s at stake is the underlying dynamic of how Facebook runs its business, operates its system, and makes decisions that have nothing to do with how its users want Facebook to operate. It’s not about research. It’s a question of power.
https://medium.com/message/what-does-the-facebook-experiment-teach-us-c858c08e287f
For scholarly publishing, the secret sauce - the essential thing - is a mechanism for review. Even open archives like arXiv.org have review in the sense of only letting people who are endorsed by an existing community post, but here we’ll assume that we’re doing something more like traditional academic publishing - reviewing something called a paper (it could actually be code, or a figure, or a paragraph but let’s stick to papers as that’s easier to think about). Peer review at present is something that belongs to a journal; it’s a set of rules and procedures, written and enforced by an editorial board and supported by a lot of email and some fairly wonky software.
http://theoj.org/
The publishers Springer and IEEE are removing more than 120 papers from their subscription services after a French researcher discovered that the works were computer-generated nonsense. Over the past two years, computer scientist Cyril Labbé of Joseph Fourier University in Grenoble, France, has catalogued computer-generated papers that made it into more than 30 published conference proceedings between 2008 and 2013. Sixteen appeared in publications by Springer, which is headquartered in Heidelberg, Germany, and more than 100 were published by the Institute of Electrical and Electronic Engineers (IEEE), based in New York. Both publishers, which were privately informed by Labbé, say that they are now removing the papers. Among the works were, for example, a paper published as a proceeding from the 2013 International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering, held in Chengdu, China. (The conference website says that all manuscripts are “reviewed for merits and contents”.) The authors of the paper, entitled ‘TIC: a methodology for the construction of e-commerce’, write in the abstract that they “concentrate our efforts on disproving that spreadsheets can be made knowledge-based, empathic, and compact”. (Nature News has attempted to contact the conference organizers and named authors of the paper but received no reply; however at least some of the names belong to real people. The IEEE has now removed the paper).
http://www.nature.com/news/publishers-withdraw-more-than–120-gibberish-papers–1.14763
