Electronic lab notebook
Hi all,
I'm starting on a new position soon, and thought I would start getting organized: having written my PhD thesis recently made me realize how hard it is to find the older things I've been doing. For that reason, I'm looking for an electronic lab notebook software: like keeping a good old paper notebook with my results clipped in it, and hand-written notes, but on my Mac. I've seen the web pages for Lab Notebook (http://www.macinchem.fsnet.co.uk/labnotebook.htm) and Labtrack (http://www.labtrack.com/), but I'm neither impressed nor eager to try them...
What do you use? What have you tried?
PS: To give more insight, here's what the dream app would be:
* easy copy-pasting/drag 'n drop
* ability to re-open the files
* metadata and search (tags, keywords, ...)
* possiblity to link to older notes and graphs
* store PDF (or TIFF) representation of external files along with the original file: preview files without their originating application
* automated backup mechanism
* encryption on disk
Things that can be important to some people, but which I don't consider of primary importance for me:
* any kind of certification, digital signing, etc.



try journler
You should have a look on the application journler http://journler.com/.
It's not specifically made for science purpose but that shouldn't be a problem. It has note taking, file managing with keywords, embedding of external files and many other features. also it's free.
journler
Yup, I just started using journler too, a few weeks ago. The only thing it won't do for me is export attached files when I export entries. Journler is scriptable so I should be able to make my own export format with an AppleScript, but I haven't gotten around to it yet.
Electronic Notebooks
Most of the major players in the area are moving away from desktop applications to client server architectures with all the data stored in a SQL (usually Oracle) database on a remote server. This is obviously great for the big corporations who are willing and able to pay the multi-million dollar price tag. Do you need 21 CFR Part 11 compliance?
You could look at
Notebookmaker http://www.notebookmaker.com/
ORNL http://www.csm.ornl.gov/~geist/java/applets/enote/ (Not updated recently)
There are also and open source projects
http://www.opensourceeln.org/Members/webmaster/core/front.txt
Also have a browse around here
http://www.iqpc.com/cgi-bin/templates/genevent.html?topic=237&event=13555&
File obsolescence; also Notebook and DevonThink (Pro, Office)
Notebook (Circus Ponies) and DevonThink (Pro and Office) should probably fall under your gaze. DT Office has OCR in it which is nice for those papers that are PDF bitmaps.
On another note--I would be careful to not select something that uses a file format that might become unsupported at some time. You might not be thinking of it now, but for a person whose career spans decades this is a very serious consideration. I wrote my dissertation as well a whole lot of other things in FullWrite Professional (still the greatest word process of all Mac time). Fun while it lasted, but I still need to look at some of those old files (letters to patent attorney, e.g.) and OS X on a G4 is the last gasp because the Intel processors do not run Classic, as I understand. (I wish I could figure out how to write a script to automatically convert them all to Postscript rather than do it all manually.)
I now have an aversion to single-source file formats. Some of these notebook programs store their goodies in a package so you can still get at them, but who wants to convert GB's of data by hand when the developer dies or loses interest in his program? Also, many of them can export as a web site which is pretty nice, and maybe all you need in the long run, but again, that's a gamble.
As for your original question (what notebook) I'm holding out hope for the Finder in 10.5--it is supposed to have a preview feature. What I'm hoping for is that Apple has the sense to provide a plug-in feature so that app makers can write a preview plug-in for their non-standard files. In the meantime, Path Finder has a decent preview feature for some file formats.
Electronic Lab Notebook
We're actually writing an RFP for electronic lab notebooks now.
We're looking for an enterprise solution with an rdbms back end and cross-platform friendly interface.
I too would be concerned with proprietary file formats. You are apt to get stuck trying to convert them to something portable sooner rather than later...
I'll post updates as our process moves along for selecting a product.
Enterprise Lab Notebook
I'm sure many people would be interested in hearing about your efforts.
The issue of proprietary file formats is a concern, not just for the notebook but also for all those diverse applications that scientists like to use. Whilst some have open standards many are closed binary formats. In a project I was involved with we ended up having a print to database that saved a pdf version of the output. Not ideal but it was hoped that in the worst case it could be read and rekeyed if needed. MacOSX was rather nice in that it was easy to install in the PDF button in the print dialog.
Wikis
You might consider some of the Wiki options available. Gina Trapani makes the suggestion to try installing your own Wikipedia (which supports LaTeX) or Instiwiki. See Hacks #4 and #5 from Lifehacker (Chapter 1).
There are also lots of TiddlyWiki options developed explicitly for this. TiddlyWiki is light weight, simple, flexible, and can be stored on a flash drive. Oh, and because it's all done in JavaScript accessed via any modern web browser, it's portable. These TW lab notebook options often include the jsMath plugin which allows LaTeX to be used within the Tiddlers.
One old favorite is TiddlyWiki Student Edition (SE), which may or may not be useful for general lab note taking.
If you do more TiddlyWiki searching, you might find lots of options that work for you.
All of that being said, there's also the OpenSource Electronic Lab Notebook.
--
Ted Pavlic
http://www.tedpavlic.com/
http://phaseportrait.blogspot.com/
Wikis
You might consider some of the Wiki options available. Gina Trapani makes the suggestion to try installing your own Wikipedia (which supports LaTeX) or Instiwiki. See Hacks #4 and #5 from Lifehacker (Chapter 1).
There are also lots of TiddlyWiki options developed explicitly for this. TiddlyWiki is light weight, simple, flexible, and can be stored on a flash drive. Oh, and because it's all done in JavaScript accessed via any modern web browser, it's portable. These TW lab notebook options often include the jsMath plugin which allows LaTeX to be used within the Tiddlers.
One old favorite is TiddlyWiki Student Edition (SE), which may or may not be useful for general lab note taking.
If you do more TiddlyWiki searching, you might find lots of options that work for you.
All of that being said, there's also the OpenSource Electronic Lab Notebook.
--
Ted Pavlic
http://www.tedpavlic.com/
http://phaseportrait.blogspot.com/
wikis
I have considered Wikis and blogs too. One advantage to the web based tools is that you can use wget or some other program to download static html pages of the entire site that are viewable without the database and webserver. I suppose html will survive file format obsoletion longer than anything else.
Another Mac ELN to try
You might try the CERF-Notebook™, which runs great on Mac OS X and Windows. Made by Rescentris, it offers all the features you ask for as well as full 21CFR11 compliance, audit trails, etc. It's in use by many academic as well as commercial (pharma) organizations.
My ResearchWiki
Let me take this opportunity to second using wiki software.
http://www.cmms.pitt.edu/~albert
Using the wiki has provided the following advantages
- no compatiblity issues: because it's a web-page nearly every operating system and browser will display the information exactly as intended
- complete history of every page (and uploaded file): if it appeared once on the wiki it will never be lost
- extendable: Almost anything is possible with simple php extensions (i.e. embed flash movies, bibtex support, enhanced security features, and I have just replaced the search function with Google Custom Search)
- collaboration: wikis can be setup for multiple users to edit, or using the discussion features. Users also have private sections that only they can edit.
- journaled entries: traditional dated entries can be kept and searched
For me, using the wiki has changed the whole concept of a lab notebook. No longer am I forced into a daily journal of my activities with information scattered over weeks and months of entries. Now, consistent information is presented which forces me to think beyond just collecting data and writting it down.
Albert
Leopard Server's Group Wiki
I agree completely with you Albert -- that's one reason that the "Teams" features in Leopard server look so compelling. You can set up group calendars, wikis and blogs very quickly for yourself or the research group.
As soon as Leopard server is released, I'll have a walk-through of setting up a group wiki for my group. A few key additions to your list for a good lab notebook or wiki IMHO:
- Attachments (i.e., being able to attach graphics, data files, program archives, source code, etc.)
- Authentication: one key requirement for paper notebooks as well as electronic lab notebooks is authentication and signing (e.g., for patent or legal requirements).
But as you said, a wiki is great for collecting information and keeping it organized. Being able to link between multiple entries is very useful.
OmniOutliner
Have you seen OmniOutliner http://www.omnigroup.com/applications/omnioutliner/
Labbook
If you have experience with LaTeX, try the labbook package (http://tug.ctan.org/cgi-bin/ctanPackageInformation.py?id=labbook).
Copy and paste is a given and since files are stored in ASCII text, they can be reopened for millennia to come. If you use pdflatex to publish the lab notebooks, you can use all of the metadata associated with a pdf. You can also take advantage of link creation for pdfs to link to older notes/graphs.
You'll have to take care of your own backups, but if you use an automated backup system that task isn't too onerous. Finally, you can use Disk Utility to save files in an encrypted DMG.
Matt Kizerian
Systems Engineer
ReliOn, Inc.
www.relion-inc.com
TiddlyWiki Plugins
Hi,
What TW plugins do you have running?
Dan.
New Labbook approach
I have just prepared a new E-Labbook system. It's and integration between Wordpress (for Lab Blog) and phpBB (for labbok).
You can find some information at my site www.francescocimino.it
Actually my siste is under construction so just few information are reported. However I'm just preparing an HOW-TO build an e-Labbook.
Francesco
Electronic lab notebook
One possibility (shameless plug, but actually on topic...) if you use Mathematica--which is required for it--is my product "A WorkLife FrameWork":
http://Scientificarts.com/worklife
Send me a note if you have any questions... there's a trial version).
David Reiss
http://Scientificarts.com/worklife