[Refdb-devel] [ refdb-Bugs-1951049 ] bibtex + ELEC

Discussion:

SourceForge.net

2008-04-24 18:07:11 UTC

Bugs item #1951049, was opened at 2008-04-24 19:07
Message generated for change (Tracker Item Submitted) made by Item Submitter
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951049&group_id=26091

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: refdbd
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Damien Jade Duff (damienjadeduff)
Assigned to: Markus Hoenicka (mhoenicka)
Summary: bibtex + ELEC

Initial Comment:

Hi again!

Now I think I've got a history with this citation type. However, this report should be unrelated to that old stuff (hope so).

Now bibtex generation of ELEC entries into MISC bibtex types is dropping the AUTHOR part. This is new to 1.0.0-pre1 (and in svn). In 0.9.9-1 this generation was adding an extra comma instead (or this change may have occured because I have updated some other software on which refdb depends while I did the upgrade to svn).

See the example below.

Thanks again!
Damien

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t bibtex -N 1 :TY:=ELEC > bib1.bib
999:1 retrieved:0 failed

mycomp% cat bib1.bib
@MISC{ ZIEMKE2001,
YEAR = {2005},
TITLE = {Are Robots Embodied?},
URL = { http://www.ida.his.se/\~tom/EpiRob.web.pdf}
}

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t risx -N 1 :TY:=ELEC > bib1.risx
999:1 retrieved:0 failed

mycomp% cat bib1.risx
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [
<!ENTITY lt "&#60;">
<!ENTITY gt ">">
<!ENTITY amp "&#38;">
<!ENTITY mdash "—">
<!ENTITY lsquo "‘">
<!ENTITY rsquo "’">
]>
<ris>

<entry type="ELEC" id="2" citekey="ZIEMKE2001">
<publication>
<title type="full">Are Robots Embodied?</title>
<author>
<lastname>Ziemke</lastname>
<firstname>Tom</firstname>
</author>
<pubinfo>
<pubdate type="primary">
<date><year>2005</year></date>
</pubdate>
<link type="url">http://www.ida.his.se/~tom/EpiRob.web.pdf</link>
</pubinfo>
</publication>
<libinfo user="djd">
<notes>Entered For/PhD</notes>
<reprint status="INFILE"/>
<availability type="useroot">Embodied Robots/Ziemke2001.pdf</availability>
</libinfo>
<contents>
<keyword>embodied</keyword>
<keyword>embodied robotics</keyword>
<keyword>robotics</keyword>
</contents>
</entry>
</ris>
acws-0175%

My system configuration now is:
refdb-1.0.0-pre1 (also happening on the svn as of this morning)
libdbi-cvs-20080421
libdbi-drivers-cvs-20080421
sqlite-3.5.8
Linux acws-0175 2.6.9-67.0.7.ELsmp #1 SMP Sat Mar 15 06:54:55 EDT 2008 i686 i686 i386 GNU/Linux

Cheerios!
Damien

----------------------------------------------------------------------

You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951049&group_id=26091

SourceForge.net

2008-04-25 16:05:24 UTC

Permalink

Bugs item #1951049, was opened at 2008-04-24 19:07
Message generated for change (Comment added) made by damienjadeduff
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951049&group_id=26091

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: refdbd
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Damien Jade Duff (damienjadeduff)
Assigned to: Markus Hoenicka (mhoenicka)
Summary: bibtex + ELEC

Initial Comment:

Hi again!

Now I think I've got a history with this citation type. However, this report should be unrelated to that old stuff (hope so).

Now bibtex generation of ELEC entries into MISC bibtex types is dropping the AUTHOR part. This is new to 1.0.0-pre1 (and in svn). In 0.9.9-1 this generation was adding an extra comma instead (or this change may have occured because I have updated some other software on which refdb depends while I did the upgrade to svn).

See the example below.

Thanks again!
Damien

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t bibtex -N 1 :TY:=ELEC > bib1.bib
999:1 retrieved:0 failed

mycomp% cat bib1.bib
@MISC{ ZIEMKE2001,
YEAR = {2005},
TITLE = {Are Robots Embodied?},
URL = { http://www.ida.his.se/\~tom/EpiRob.web.pdf}
}

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t risx -N 1 :TY:=ELEC > bib1.risx
999:1 retrieved:0 failed

mycomp% cat bib1.risx
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [
<!ENTITY lt "&#60;">
<!ENTITY gt ">">
<!ENTITY amp "&#38;">
<!ENTITY mdash "—">
<!ENTITY lsquo "‘">
<!ENTITY rsquo "’">
]>
<ris>

<entry type="ELEC" id="2" citekey="ZIEMKE2001">
<publication>
<title type="full">Are Robots Embodied?</title>
<author>
<lastname>Ziemke</lastname>
<firstname>Tom</firstname>
</author>
<pubinfo>
<pubdate type="primary">
<date><year>2005</year></date>
</pubdate>
<link type="url">http://www.ida.his.se/~tom/EpiRob.web.pdf</link>
</pubinfo>
</publication>
<libinfo user="djd">
<notes>Entered For/PhD</notes>
<reprint status="INFILE"/>
<availability type="useroot">Embodied Robots/Ziemke2001.pdf</availability>
</libinfo>
<contents>
<keyword>embodied</keyword>
<keyword>embodied robotics</keyword>
<keyword>robotics</keyword>
</contents>
</entry>
</ris>
acws-0175%

My system configuration now is:
refdb-1.0.0-pre1 (also happening on the svn as of this morning)
libdbi-cvs-20080421
libdbi-drivers-cvs-20080421
sqlite-3.5.8
Linux acws-0175 2.6.9-67.0.7.ELsmp #1 SMP Sat Mar 15 06:54:55 EDT 2008 i686 i686 i386 GNU/Linux

Cheerios!
Damien

----------------------------------------------------------------------

Comment By: Damien Jade Duff (damienjadeduff)

Date: 2008-04-25 17:05

Message:
Logged In: YES
user_id=2066694
Originator: YES

Hi

I just noticed that this applies also to BOOK ris types (always) and GEN
ris types (when the author is inside the risx publication tag) - bibtex
generation is not giving back the author. Hope this is useful..

Peace
Damien

mycomp% refdbd -v
refdbd 1.0.0-pre1 built from svn revision 613 ***@mhoenicka.de
You may redistribute and modify this software under the terms of the GNU
General Public License.

----------------------------------------------------------------------

You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951049&group_id=26091

SourceForge.net

2008-04-27 20:47:50 UTC

Permalink

Bugs item #1951049, was opened at 2008-04-24 20:07
Message generated for change (Comment added) made by mhoenicka
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951049&group_id=26091

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: refdbd
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Damien Jade Duff (damienjadeduff)
Assigned to: Markus Hoenicka (mhoenicka)
Summary: bibtex + ELEC

Initial Comment:

Hi again!

Now I think I've got a history with this citation type. However, this report should be unrelated to that old stuff (hope so).

Now bibtex generation of ELEC entries into MISC bibtex types is dropping the AUTHOR part. This is new to 1.0.0-pre1 (and in svn). In 0.9.9-1 this generation was adding an extra comma instead (or this change may have occured because I have updated some other software on which refdb depends while I did the upgrade to svn).

See the example below.

Thanks again!
Damien

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t bibtex -N 1 :TY:=ELEC > bib1.bib
999:1 retrieved:0 failed

mycomp% cat bib1.bib
@MISC{ ZIEMKE2001,
YEAR = {2005},
TITLE = {Are Robots Embodied?},
URL = { http://www.ida.his.se/\~tom/EpiRob.web.pdf}
}

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t risx -N 1 :TY:=ELEC > bib1.risx
999:1 retrieved:0 failed

mycomp% cat bib1.risx
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [
<!ENTITY lt "&#60;">
<!ENTITY gt ">">
<!ENTITY amp "&#38;">
<!ENTITY mdash "—">
<!ENTITY lsquo "‘">
<!ENTITY rsquo "’">
]>
<ris>

<entry type="ELEC" id="2" citekey="ZIEMKE2001">
<publication>
<title type="full">Are Robots Embodied?</title>
<author>
<lastname>Ziemke</lastname>
<firstname>Tom</firstname>
</author>
<pubinfo>
<pubdate type="primary">
<date><year>2005</year></date>
</pubdate>
<link type="url">http://www.ida.his.se/~tom/EpiRob.web.pdf</link>
</pubinfo>
</publication>
<libinfo user="djd">
<notes>Entered For/PhD</notes>
<reprint status="INFILE"/>
<availability type="useroot">Embodied Robots/Ziemke2001.pdf</availability>
</libinfo>
<contents>
<keyword>embodied</keyword>
<keyword>embodied robotics</keyword>
<keyword>robotics</keyword>
</contents>
</entry>
</ris>
acws-0175%

My system configuration now is:
refdb-1.0.0-pre1 (also happening on the svn as of this morning)
libdbi-cvs-20080421
libdbi-drivers-cvs-20080421
sqlite-3.5.8
Linux acws-0175 2.6.9-67.0.7.ELsmp #1 SMP Sat Mar 15 06:54:55 EDT 2008 i686 i686 i386 GNU/Linux

Cheerios!
Damien

----------------------------------------------------------------------

Comment By: Markus Hoenicka (mhoenicka)

Date: 2008-04-27 22:47

Message:
Logged In: YES
user_id=85809
Originator: NO

Are you still using reference databases created with RefDB 0.9.8 or
earlier? As I cannot reproduce this problem here, I suspect your reference
database was not properly upgraded when moving from 0.9.8 to the current
version. The internal data representation has changed somewhat, and this
would nicely explain the problems you see. Please check carefully the
UPGRADING file which explains the background and the proper procedure to
upgrade. Let me know if the problem persists, or if you can reproduce it
with a fresh database created with 0.9.9 or later.

regards,
Markus

----------------------------------------------------------------------

Comment By: Damien Jade Duff (damienjadeduff)
Date: 2008-04-25 18:05

Message:
Logged In: YES
user_id=2066694
Originator: YES

Hi

I just noticed that this applies also to BOOK ris types (always) and GEN
ris types (when the author is inside the risx publication tag) - bibtex
generation is not giving back the author. Hope this is useful..

Peace
Damien

mycomp% refdbd -v
refdbd 1.0.0-pre1 built from svn revision 613 ***@mhoenicka.de
You may redistribute and modify this software under the terms of the GNU
General Public License.

----------------------------------------------------------------------

You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1951049&group_id=26091

SourceForge.net

2008-04-30 14:09:24 UTC

Permalink

Comment By: Damien Jade Duff (damienjadeduff)

Date: 2008-04-30 15:09

Message:
Logged In: YES
user_id=2066694
Originator: YES

Hiya

Thanks lots Markus for your fixes! Works fine for the other bug [ 1951835
] now.

I've had an opportunity to take a look at this other problem [ 1951049 ]
(bibtex + ELEC) from the latest SVN version and unfortunately the problem
persists, the publication author is still lost when generating bibtex.
Again, I'm creating a blank DB as per previous script - using
refdb.3.dump.sqlite (when using refdbd -a, which is working now - yay! -
the issue is also produced) then starting refdbd then using createdb in
refdba to create a reference DB then uploading my test reference from risx
- same config files as in previous script too.

I've also attached the refdbd output for the getref -t bibtex command at
the bottom.

Let us map out these little-trodden hills so that others who come after
may wonder at the weird little patterns of stones.

Peace
Damien

mycomp% refdbc -u 123 -w 123 -C countref :ID:\>0
999:0 counted

mycomp% cat ~/testauthorloss.risx
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN"
"http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [
<!ENTITY lt "&#60;">
<!ENTITY gt ">">
<!ENTITY amp "&#38;">
<!ENTITY mdash "—">
<!ENTITY lsquo "‘">
<!ENTITY rsquo "’">
]>
<ris>

<entry type="BOOK" id="8" citekey="CORBALLIS2003">
<publication>
<title type="full">

SourceForge.net

2008-04-30 22:53:23 UTC

Permalink

Comment By: Markus Hoenicka (mhoenicka)

Date: 2008-05-01 00:53

Message:
Logged In: YES
user_id=85809
Originator: NO

Hi,

you caught me red-handed! I thought I'd get away with testing the bibtex
output of a couple of existing entries, but these tests went ok. Now I ran
the test just as you outlined, using your original data, and voila - the
author is gone. Turns out it was a problem of the risx import. refdbd is
supposed to assign default author roles unless roles are specifically
requested in a risx dataset. This works ok with RIS data, but a stupid bug
in the risx import would assign roles only if they were explicitly taken
from the risx dataset, leaving the field empty otherwise. The bibtex output
is the only one that strictly relies on author roles (to distinguish
authors from editors), so this is where the problem finally haunted me.

I've checked in a new version of risxhandler.c which should fix this
problem.

regards,
Markus

----------------------------------------------------------------------

Comment By: Damien Jade Duff (damienjadeduff)
Date: 2008-04-30 16:09

Message:
Logged In: YES
user_id=2066694
Originator: YES

Hiya

Thanks lots Markus for your fixes! Works fine for the other bug [ 1951835
] now.

I've had an opportunity to take a look at this other problem [ 1951049 ]
(bibtex + ELEC) from the latest SVN version and unfortunately the problem
persists, the publication author is still lost when generating bibtex.
Again, I'm creating a blank DB as per previous script - using
refdb.3.dump.sqlite (when using refdbd -a, which is working now - yay! -
the issue is also produced) then starting refdbd then using createdb in
refdba to create a reference DB then uploading my test reference from risx
- same config files as in previous script too.

I've also attached the refdbd output for the getref -t bibtex command at
the bottom.

Let us map out these little-trodden hills so that others who come after
may wonder at the weird little patterns of stones.

Peace
Damien

mycomp% refdbc -u 123 -w 123 -C countref :ID:\>0
999:0 counted

mycomp% cat ~/testauthorloss.risx
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN"
"http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [
<!ENTITY lt "&#60;">
<!ENTITY gt ">">
<!ENTITY amp "&#38;">
<!ENTITY mdash "—">
<!ENTITY lsquo "‘">
<!ENTITY rsquo "’">
]>
<ris>

<entry type="BOOK" id="8" citekey="CORBALLIS2003">
<publication>
<title type="full">

SourceForge.net

2008-05-01 09:47:07 UTC

Permalink

Status: Closed

Resolution: None
Priority: 5
Private: No
Submitted By: Damien Jade Duff (damienjadeduff)
Assigned to: Markus Hoenicka (mhoenicka)
Summary: bibtex + ELEC

Initial Comment:

Hi again!

Now I think I've got a history with this citation type. However, this report should be unrelated to that old stuff (hope so).

Now bibtex generation of ELEC entries into MISC bibtex types is dropping the AUTHOR part. This is new to 1.0.0-pre1 (and in svn). In 0.9.9-1 this generation was adding an extra comma instead (or this change may have occured because I have updated some other software on which refdb depends while I did the upgrade to svn).

See the example below.

Thanks again!
Damien

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t bibtex -N 1 :TY:=ELEC > bib1.bib
999:1 retrieved:0 failed

mycomp% cat bib1.bib
@MISC{ ZIEMKE2001,
YEAR = {2005},
TITLE = {Are Robots Embodied?},
URL = { http://www.ida.his.se/\~tom/EpiRob.web.pdf}
}

mycomp% refdbc -u djd -w 123 -d djdphd -C getref -t risx -N 1 :TY:=ELEC > bib1.risx
999:1 retrieved:0 failed

mycomp% cat bib1.risx
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN" "http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [
<!ENTITY lt "&#60;">
<!ENTITY gt ">">
<!ENTITY amp "&#38;">
<!ENTITY mdash "—">
<!ENTITY lsquo "‘">
<!ENTITY rsquo "’">
]>
<ris>

<entry type="ELEC" id="2" citekey="ZIEMKE2001">
<publication>
<title type="full">Are Robots Embodied?</title>
<author>
<lastname>Ziemke</lastname>
<firstname>Tom</firstname>
</author>
<pubinfo>
<pubdate type="primary">
<date><year>2005</year></date>
</pubdate>
<link type="url">http://www.ida.his.se/~tom/EpiRob.web.pdf</link>
</pubinfo>
</publication>
<libinfo user="djd">
<notes>Entered For/PhD</notes>
<reprint status="INFILE"/>
<availability type="useroot">Embodied Robots/Ziemke2001.pdf</availability>
</libinfo>
<contents>
<keyword>embodied</keyword>
<keyword>embodied robotics</keyword>
<keyword>robotics</keyword>
</contents>
</entry>
</ris>
acws-0175%

My system configuration now is:
refdb-1.0.0-pre1 (also happening on the svn as of this morning)
libdbi-cvs-20080421
libdbi-drivers-cvs-20080421
sqlite-3.5.8
Linux acws-0175 2.6.9-67.0.7.ELsmp #1 SMP Sat Mar 15 06:54:55 EDT 2008 i686 i686 i386 GNU/Linux

Cheerios!
Damien

----------------------------------------------------------------------

Comment By: Damien Jade Duff (damienjadeduff)

Date: 2008-05-01 10:47

Message:
Logged In: YES
user_id=2066694
Originator: YES

'Allo!
Seems to have done the job! Full speed ahead!
Cheerios
Damien

----------------------------------------------------------------------

Comment By: Markus Hoenicka (mhoenicka)
Date: 2008-04-30 23:53

Message:
Logged In: YES
user_id=85809
Originator: NO

Hi,

you caught me red-handed! I thought I'd get away with testing the bibtex
output of a couple of existing entries, but these tests went ok. Now I ran
the test just as you outlined, using your original data, and voila - the
author is gone. Turns out it was a problem of the risx import. refdbd is
supposed to assign default author roles unless roles are specifically
requested in a risx dataset. This works ok with RIS data, but a stupid bug
in the risx import would assign roles only if they were explicitly taken
from the risx dataset, leaving the field empty otherwise. The bibtex output
is the only one that strictly relies on author roles (to distinguish
authors from editors), so this is where the problem finally haunted me.

I've checked in a new version of risxhandler.c which should fix this
problem.

regards,
Markus

----------------------------------------------------------------------

Comment By: Damien Jade Duff (damienjadeduff)
Date: 2008-04-30 15:09

Message:
Logged In: YES
user_id=2066694
Originator: YES

Hiya

Thanks lots Markus for your fixes! Works fine for the other bug [ 1951835
] now.

I've had an opportunity to take a look at this other problem [ 1951049 ]
(bibtex + ELEC) from the latest SVN version and unfortunately the problem
persists, the publication author is still lost when generating bibtex.
Again, I'm creating a blank DB as per previous script - using
refdb.3.dump.sqlite (when using refdbd -a, which is working now - yay! -
the issue is also produced) then starting refdbd then using createdb in
refdba to create a reference DB then uploading my test reference from risx
- same config files as in previous script too.

I've also attached the refdbd output for the getref -t bibtex command at
the bottom.

Let us map out these little-trodden hills so that others who come after
may wonder at the weird little patterns of stones.

Peace
Damien

mycomp% refdbc -u 123 -w 123 -C countref :ID:\>0
999:0 counted

mycomp% cat ~/testauthorloss.risx
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE ris PUBLIC "-//Markus Hoenicka//DTD Ris V1.2.0//EN"
"http://refdb.sourceforge.net/dtd/risx-1.2.0/risx.dtd" [
<!ENTITY lt "&#60;">
<!ENTITY gt ">">
<!ENTITY amp "&#38;">
<!ENTITY mdash "—">
<!ENTITY lsquo "‘">
<!ENTITY rsquo "’">
]>
<ris>

<entry type="BOOK" id="8" citekey="CORBALLIS2003">
<publication>
<title type="full">