Hacks


1
Mar 09

Citation Searching in Google Scholar

One of my favorite features in Google Scholar is its “cited by” function.  Cited by allows you to see all of the items in Google Scholar that cite the pulbication you were searching for.  In comparison to Web of Science, GS has much greater recall, which is useful when you’re investigating a new topic.

The problem with GS cited by is that there is no easy means for searching within the results.  This is fine if your publication is cited only a few times and you can eyeball the results.  But as the citation count scales up, being able to search within the results becomes pretty important.

The good news is that you can search within GS cited by, it just requires a little URL hacking.  In my case, I was looking for publications about web surveys that cite the Reeves and Nass book “The Media Equation.”  We’ll do this step by step:

  1. Open up GS, and search for “The Media Equation
  2. The first result is the Reeves and Nass book.  Click on the “Cited by 1598” link.
  3. The URL will look something like this:

    http://scholar.google.com/scholar?num=50&hl=en&lr=&cites=12773235514158955901

    You will want to select that list bit, the “&cites=12773235514158955901″.

  4. Now, open up GS in a new tab and run a search for “Web Survey.”
  5. Finally, paste the “&cites=12773235514158955901″ onto the end Web Survey URL, so it looks something like this:

    http://scholar.google.com/scholar?num=50&hl=en&lr=&q=Web+Survey&btnG=Search&cites=12773235514158955901

  6. Voila!  You’ve found the 337 publications matching Web Surveys that cite the Reeves and Nass book.  The first one looks like a very promising publication from some highly regarded methodologists.  Win!

”gsresults”

I was unable to run a comparison in the WoS database as it doesn’t seem to know about the Reeves and Nass book.  Are there any other places you use for Cited By searches (i.e. other databases, vendors, search engine hacks)?  And if there is some easy way to do this search in the GS interface, please let me know.  I’ve read the advanced searching docs and researched this, but it doesn’t appear there is a simple way to search within citations.


20
Feb 09

BibTex and Word Documents

Via Academic Productivity, I’ve been looking for this forever:

BibTex4Word is an add-in for Microsoft Word that allows the citation of references from a BibTex database. BibTex4Word will insert a bibliography into your document using your choice formatting style.

It is intended for three types of user:

1. LateX users who need to use Microsoft Word. BibTex4Word allows you to use your existing BibTex database and favourite bibliography style.

2. Word users who can’t afford a commercial bibliography package but need to insert citations and bibliographies into their documents. Everything you need to manage references is available free.

3. Word users who have a commercial bibliography package but who don’t like it. BibTex4Word is lightweight, transparent and doesn’t mess up your documents. It is also free.

I’m completely married to Bibdesk as my reference manager, but the lack of Word integration has always caused headaches.  I’m very excited to have found an answer.


27
Jan 09

Times Open, Feb. 20

Awesome:

Announcing Times Open, a day-long event for developers interested in working with NYTimes.com as a news and information platform. When we started this Open blog, we also embarked on a mission to share more of what we do on the development side of The Times. So far, we’ve done that via conference presentations, open-source software, blog posts and (most recently and probably most importantly) our APIs. Times Open is the next logical step in our vision of NYTimes.com. We see our site as more than just a source of news and information: it’s a platform on which news and information become building blocks.

If only I had the time/money/bandwidth to get there – there are some awesome things to be built with the Gray Lady’s data.  Featuring my buddy Gabriel Dance.


22
Dec 08

Announcing Freedom v0.4

I’m pleased to release Freedom v0.4, a major update to the Freedom software.  This new version is a fresh rewrite, incorporating the ability to access local networks, an extended time period, and many significant bug fixes.  Particularly, Freedom’s authentication mechanism has changed (fixing the password-timeout bug) and Freedom will now appropriately handle suspends and sleeps.

Freedom v0.4 remains Mac only, and it is tested through OS 10.5.6.  This new version was paid for (thank you!) by those who have donated in the past.  I strongly recommend that all users upgrade as soon as possible.

Download Freedom directly (.dmg)

Freedom’s website.

If you run into any problems/have suggestions please leave them in the comments.  I do not plan on developing a Windows version, sorry.

Previous posts about Freedom:

Productive Unit Structures: Introducing Freedom
New Version of Freedom: v0.3
Freedom in the Telegraph


2
Dec 08

Hacking Google Scholar

If you connect to Google Scholar through a proxy (for example, through your library’s proxy), you’ll find that GS is unable to remember your preference settings.  Although Google seems to forget my preferences far too often, in the case of Google Scholar it isn’t their fault.  When you connect through a proxy you appear to Google as a different user every time, and until preferences are tied to your Google account (and not a session/cookie), Google is simply unable to remember them.

To “solve” this problem, I’ve found that you can set a bookmark that will set your preferences each time it is clicked.  While this doesn’t solve the problem of Google forgetting preferences between sessions, it will save you the time and effort of having to reset your preferences each time.  You will need to custom-craft your bookmark.  Here’s mine:

http://scholar.google.com/scholar_setprefs?num=50&scis=yes&scisf=4&submit=Save+Preferences

As you can see, in with I’m passing some options to “scholar_setprefs” – i.e. the mechanism that sets your Google Scholar preferences.  I’m manipulating two options, Number of Results (num=50) and Bibliography manager (scis=yes&scisf=4).  I could also directly manipulate the interface and search language, library links, and if the results opened new windows or not (I don’t because I’m happy with the GS defaults).

The options accept a range of values, which I’ll describe briefly:

Number of results (num), accepts:

  • 10
  • 20
  • 30
  • 50
  • 100

If you’d like 100 results to be displayed, you’d change the url so that num=100.

Bibliography manager (scis=yes&scisf=4).  Google Scholar supports a number of different export formats, and to change their default, you’ll need to change the scisf value.  Here are the corresponding values:

  • 4 (Bibtex)
  • 3 (EndNote)
  • 2 (RefMan)
  • 1 (RefWorks)
  • 5 (WenXianWang)

If you’re a RefWorks user, you’d change the string so that it looked like this scis=yes&scisf=1.

Putting it all together, if you’re a RefWorks user who wants 100 results displayed, you’d set your bookmark as follows:

http://scholar.google.com/scholar_setprefs?num=100&scis=yes&scisf=1&submit=Save+Preferences

Finally, if you’re accessing GS through your library proxy, you’ll need to add the proxy information into the URL. In the case of UNC we place the proxy information directly in the url. Therefore, my proxied bookmark looks like this:

http://scholar.google.com.libproxy.lib.unc.edu/scholar_setprefs?num=50&scis=yes&scisf=4&submit=Save+Preferences

As you can see, I’ve added .libproxy.lib.unc.edu to the beginning of the URL. This will vary by library, so you’ll want to look at other proxied URL’s at your institution to get a feel for where the proxy information goes.  As I noted above, there are a bunch of other options you can change directly. If you’d like to change those, simply view the source of the Google Scholar preferences page, look for the option and value pairs in the form, and tack them into the URL (making sure to add & before the option/value pair).


22
Nov 08

Fixing Google with Adblock Plus

TechCrunch is right – Google, It Wasn’t Broke.  Google has rolled personalization at the item level into search, cluttering their elegant interface.  As far as I can tell, this affects all users who are logged in with a Google account (i.e. Gmail, etc), and there’s no way to opt out.  Now, I’m not against personalization – if you want it.  And while it appears there’s no way to opt out, you can make the cluttering icons disappear with Adblock plus (Firefox users).  To make the buttons and conversation icon disappear, add the following “element hiding rules” to Adblock Plus:

google.com#BUTTON(class=wci)
google.com#BUTTON(class=w10)
google.com#BUTTON(class=w20)

Voila, Google back to normal.

Update: TechCrunch reports that Google may be rolling this feature back, and it reports on a Greasemonkey script that accomplishes the same results as this Adblock Plus filter.  I’m not a Greasemonkey user so I’m not able to verify.


9
Oct 08

Fixing the Yahoo News Toggle

Updated, thanks Dan!

Looks like Yahoo lets you toggle this off yourself, with a cookie. From Yahoo’s own help page: At the bottom of the page is an option to turn OFF expand/collapse. If you turn this off, you will not see the “Read Full Article” button anymore and will see only single, open pages.
http://help.yahoo.com/l/us/yahoo/news/expandpage.html

If you frequent Yahoo News, you’ve likely noticed the site has been redesigned.  Overall, the design is clean, information-rich, and provides a nice update to one of my favorite news sources.  Along with the redesign, Yahoo has introduced a bizarre, annoying functionality to news stories.  When a news story loads, you are delivered a truncated version of the story; to see the full story you are forced to click on the “Read Full Article” button that hovers midway in the page (generally next to an ad).  This has proven endlessly frustrating.

I figured this issue would be easy to fix.  Inspecting the code, the javascript controls are simple enough – the toggle is controlled by a simple onclick listener.  Disable the script and all should be well, right?  As it turns out, this is not as easy as it seems.  The script was inline – included in the page – meaning the only way to block it was to block all javascript in the page.  This makes Yahoo news fairly unusable.  After playing around with Adblock Plus, however, I discovered a formula that works:

news.yahoo.com#*(class=ult-section mod read-more-toggle)

This filter will prevent toggling, displaying the full page when it loads.  There are some side effects, the primary one being the story content loads last.  I was willing to trade this off to not have to click each time I wanted to read the rest of the story.  It appears that recently Firefox introduced functionality that enables just-in-time inspection and modification of pages.  Perhaps when Adblock Plus is updated there will be a more elegant solution to the inline javascript issue.