Discussion:
[Refdb-devel] [ refdb-Bugs-1550514 ] Trouble while importing chapters
SourceForge.net
2006-09-07 12:19:26 UTC
Permalink
Bugs item #1550514, was opened at 2006-09-01 15:15
Message generated for change (Comment added) made by dreusser
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1550514&group_id=26091

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: refdbd
Group: None
Status: Open
Resolution: Works For Me
Priority: 5
Submitted By: Dominik (dreusser)
Assigned to: Markus Hoenicka (mhoenicka)
Summary: Trouble while importing chapters

Initial Comment:
Queries are not assembled correctly (cutting of either
the refdb_title or redb_booktitile) while importing
chapters from a file with multiple records. For some
reason, writing the records to a seprate file and
importing from there works for some records. I attached
a file with example records that failed.


Example 1
----------
UPDATE t_refdb SET refdb_pubyear=2003, refdb_secyear=0,
refdb_pyother_info='///', refdb_secother_info=NULL,
refdb_citekey='Bardsley2003a', refdb_user1=NULL,
refdb_user2='schaeffli', refdb_user3=NULL,
refdb_user4=NULL, refdb_user5=NULL, refdb_misc1=NULL,
refdb_misc2=NULL, refdb_misc3=NULL, refdb_issn=NULL,
refdb_issue=NULL, refdb_publisher='IAHS Publication no.
281', refdb_city='Wallingford, Oxfordshire UK',
refdb_volume=NULL, refdb_endpage='74',
refdb_startpage='67', refdb_type='CHAP',
refdb_booktitle='Water resources systems - hydrological
risk, management and development (Proceedings of an
international symposium the XXIII General Assembly of
the International Union of Geodesy and Geophysics, at
Sapporo, Japan, from 30 June to 11 July 2003)',
refdb_title='An approach to creating lumped-parameter
rainfall-runoff models for drainage basins experiencing
envrionemental WHERE refdb_id=2393
1064: You have an error in your SQL syntax; check the
manual that corresponds to your MySQL server version
for the right syntax to use near ''An approach to
creating lumped-parameter rainfall-runoff models
inserting reference data failed

Example 2
---------
UPDATE t_refdb SET refdb_pubyear=1998, refdb_secyear=0,
refdb_pyother_info='///', refdb_secother_info=NULL,
refdb_citekey='Aizen1998', refdb_user1=NULL,
refdb_user2='schaeffli', refdb_user3=NULL,
refdb_user4=NULL, refdb_user5=NULL, refdb_misc1=NULL,
refdb_misc2=NULL, refdb_misc3=NULL, refdb_issn=NULL,
refdb_issue=NULL, refdb_publisher='IAHS Publication No.
248', refdb_city='Wallingford, Oxfordshire UK',
refdb_volume=NULL, refdb_endpage='198',
refdb_startpage='191', refdb_type='CHAP',
refdb_booktitle='Hydrology, Water Resources and Ecology
in Headwaters (P, refdb_title='Estimation of glacial
runoff to the Tarim River, central Tien Shan' WHERE
refdb_id=2352
1064: You have an error in your SQL syntax; check the
manual that corresponds to your MySQL server version
for the right syntax to use near 'Estimation of glacial
runoff to the Tarim River, central Tien Sh
inserting reference data failed

refdb-bug:
Linux aare 2.6.17-1-686 #1 SMP Sat Jul 29 15:32:47 UTC
2006 i686 GNU/Linux
RefDB binaries and scripts in the path:
/usr/bin/refdbd
/usr/bin/refdba
/usr/bin/refdbc
/usr/bin/refdbib
/usr/bin/bib2ris
and their version numbers:
refdbd 0.9.8-pre2
refdba 0.9.8-pre2
refdbc 0.9.8-pre2
refdbib 0.9.8-pre2
/usr/bin/refdb-bug: line 41: nmed2ris: command not found
bib2ris 0.9.8-pre2
DSSSL engines in the path:
and their version numbers:

$REFDBLIB is /usr/share/refdb
global refdbd config file:
refdblib /usr/share/refdb
serverip localhost
dbsport 3306
dbserver mysql
dbpath /var/lib/refdb/db
port 9734
logfile /var/log/refdbd.log
logdest file
loglevel info
pidfile /var/run/refdbd.pid
remoteadmin f
remoteconnect f
keep_pnames t
keyword_scan t
db_encoding
in_encoding UTF-8

global refdba config file:
serverip 127.0.0.1
port 9734
pager less
username joeuser
passwd <protected>
logdest file
loglevel info
logfile /var/log/refdba.log

global refdbc config file:
serverip 127.0.0.1
port 9734
pager less
username joeuser
passwd <protected>
logdest file
loglevel info
logfile /var/log/refdbc.log
cssurl /usr/share/refdb/css/refdb.css
fromencoding UTF-8
toencoding UTF-8

global refdbc config file (cgi):

global refdbib config file:

global nmed2ris config file:

global bib2ris config file:

$HOME is /home/dreusser
user refdba config file:

user refdba config file (hidden):
serverip 127.0.0.1
username root
passwd <protected>
pager less
toencoding ISO-8859-1
fromencoding ISO-8859-1

user refdbc config file:

user refdbc config file (hidden):
serverip 127.0.0.1
username dominik
passwd <protected>
defaultdb hykli
pager less
toencoding ISO-8859-1
fromencoding ISO-8859-1

user refdbib config file:

user refdbib config file (hidden):
serverip 127.0.0.1
username dominik
passwd <protected>
defaultdb refdb_test
pager less
toencoding ISO-8859-1

user nmed2ris config file:

user nmed2ris config file (hidden):

user bib2ris config file:

user bib2ris config file (hidden):
logfile bib2ris.log
logdest 2
loglevel 7
nsf_abstract N2
nsf_url UR
nsf_url2 UR
nsf_pdf UR
nsf_keywords KW
nsf_owner U2
nsf_comment U3
nsf_issn SN


----------------------------------------------------------------------
Comment By: Dominik (dreusser)
Date: 2006-09-07 14:19

Message:
Logged In: YES
user_id=1572139

I still get similar errors with the 0.9.8-pre3 version on
the same system. Importing works on a different system which
I just set up. Either we'll drop the issue or I can provide
you an account on my "broken" system.

----------------------------------------------------------------------

Comment By: Markus Hoenicka (mhoenicka)
Date: 2006-09-02 01:36

Message:
Logged In: YES
user_id=85809

I've never encountered problems like this one on any of my
installations. To make sure I've installed 0.9.8-pre3 (the
only difference to pre2 is the inclusion of two headers in
refdbdgetref.c to avoid compiler errors) on a pristine
Debian 3.1 box. I can import your test data without any
problems.

I'll post a message to the refdb-users list to see whether
anyone else has seen this. Unless we can pin down the
environment or the circumstances that lead to this problem,
I'll not be able to fix it.


----------------------------------------------------------------------

Comment By: Dominik (dreusser)
Date: 2006-09-01 15:33

Message:
Logged In: YES
user_id=1572139

It is not just while adding chapters. But I haven't found
out when addref fails exactly..

----------------------------------------------------------------------

You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1550514&group_id=26091
SourceForge.net
2006-09-07 18:57:46 UTC
Permalink
Bugs item #1550514, was opened at 2006-09-01 15:15
Message generated for change (Comment added) made by mhoenicka
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1550514&group_id=26091

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: refdbd
Group: None
Status: Open
Resolution: Works For Me
Priority: 5
Submitted By: Dominik (dreusser)
Assigned to: Markus Hoenicka (mhoenicka)
Summary: Trouble while importing chapters

Initial Comment:
Queries are not assembled correctly (cutting of either
the refdb_title or redb_booktitile) while importing
chapters from a file with multiple records. For some
reason, writing the records to a seprate file and
importing from there works for some records. I attached
a file with example records that failed.


Example 1
----------
UPDATE t_refdb SET refdb_pubyear=2003, refdb_secyear=0,
refdb_pyother_info='///', refdb_secother_info=NULL,
refdb_citekey='Bardsley2003a', refdb_user1=NULL,
refdb_user2='schaeffli', refdb_user3=NULL,
refdb_user4=NULL, refdb_user5=NULL, refdb_misc1=NULL,
refdb_misc2=NULL, refdb_misc3=NULL, refdb_issn=NULL,
refdb_issue=NULL, refdb_publisher='IAHS Publication no.
281', refdb_city='Wallingford, Oxfordshire UK',
refdb_volume=NULL, refdb_endpage='74',
refdb_startpage='67', refdb_type='CHAP',
refdb_booktitle='Water resources systems - hydrological
risk, management and development (Proceedings of an
international symposium the XXIII General Assembly of
the International Union of Geodesy and Geophysics, at
Sapporo, Japan, from 30 June to 11 July 2003)',
refdb_title='An approach to creating lumped-parameter
rainfall-runoff models for drainage basins experiencing
envrionemental WHERE refdb_id=2393
1064: You have an error in your SQL syntax; check the
manual that corresponds to your MySQL server version
for the right syntax to use near ''An approach to
creating lumped-parameter rainfall-runoff models
inserting reference data failed

Example 2
---------
UPDATE t_refdb SET refdb_pubyear=1998, refdb_secyear=0,
refdb_pyother_info='///', refdb_secother_info=NULL,
refdb_citekey='Aizen1998', refdb_user1=NULL,
refdb_user2='schaeffli', refdb_user3=NULL,
refdb_user4=NULL, refdb_user5=NULL, refdb_misc1=NULL,
refdb_misc2=NULL, refdb_misc3=NULL, refdb_issn=NULL,
refdb_issue=NULL, refdb_publisher='IAHS Publication No.
248', refdb_city='Wallingford, Oxfordshire UK',
refdb_volume=NULL, refdb_endpage='198',
refdb_startpage='191', refdb_type='CHAP',
refdb_booktitle='Hydrology, Water Resources and Ecology
in Headwaters (P, refdb_title='Estimation of glacial
runoff to the Tarim River, central Tien Shan' WHERE
refdb_id=2352
1064: You have an error in your SQL syntax; check the
manual that corresponds to your MySQL server version
for the right syntax to use near 'Estimation of glacial
runoff to the Tarim River, central Tien Sh
inserting reference data failed

refdb-bug:
Linux aare 2.6.17-1-686 #1 SMP Sat Jul 29 15:32:47 UTC
2006 i686 GNU/Linux
RefDB binaries and scripts in the path:
/usr/bin/refdbd
/usr/bin/refdba
/usr/bin/refdbc
/usr/bin/refdbib
/usr/bin/bib2ris
and their version numbers:
refdbd 0.9.8-pre2
refdba 0.9.8-pre2
refdbc 0.9.8-pre2
refdbib 0.9.8-pre2
/usr/bin/refdb-bug: line 41: nmed2ris: command not found
bib2ris 0.9.8-pre2
DSSSL engines in the path:
and their version numbers:

$REFDBLIB is /usr/share/refdb
global refdbd config file:
refdblib /usr/share/refdb
serverip localhost
dbsport 3306
dbserver mysql
dbpath /var/lib/refdb/db
port 9734
logfile /var/log/refdbd.log
logdest file
loglevel info
pidfile /var/run/refdbd.pid
remoteadmin f
remoteconnect f
keep_pnames t
keyword_scan t
db_encoding
in_encoding UTF-8

global refdba config file:
serverip 127.0.0.1
port 9734
pager less
username joeuser
passwd <protected>
logdest file
loglevel info
logfile /var/log/refdba.log

global refdbc config file:
serverip 127.0.0.1
port 9734
pager less
username joeuser
passwd <protected>
logdest file
loglevel info
logfile /var/log/refdbc.log
cssurl /usr/share/refdb/css/refdb.css
fromencoding UTF-8
toencoding UTF-8

global refdbc config file (cgi):

global refdbib config file:

global nmed2ris config file:

global bib2ris config file:

$HOME is /home/dreusser
user refdba config file:

user refdba config file (hidden):
serverip 127.0.0.1
username root
passwd <protected>
pager less
toencoding ISO-8859-1
fromencoding ISO-8859-1

user refdbc config file:

user refdbc config file (hidden):
serverip 127.0.0.1
username dominik
passwd <protected>
defaultdb hykli
pager less
toencoding ISO-8859-1
fromencoding ISO-8859-1

user refdbib config file:

user refdbib config file (hidden):
serverip 127.0.0.1
username dominik
passwd <protected>
defaultdb refdb_test
pager less
toencoding ISO-8859-1

user nmed2ris config file:

user nmed2ris config file (hidden):

user bib2ris config file:

user bib2ris config file (hidden):
logfile bib2ris.log
logdest 2
loglevel 7
nsf_abstract N2
nsf_url UR
nsf_url2 UR
nsf_pdf UR
nsf_keywords KW
nsf_owner U2
nsf_comment U3
nsf_issn SN


----------------------------------------------------------------------
Post by SourceForge.net
Comment By: Markus Hoenicka (mhoenicka)
Date: 2006-09-07 20:57

Message:
Logged In: YES
user_id=85809

I've sent this problem to the user list without any
response. I reckon that this is not a general problem, but a
problem on a particular (probably screwed-up) box. I'm
afraid that trying to debug this on the affected box is
above my head, as the code that assembles the query strings
is fairly straightforward and not likely to fail just so. We
might end up debugging your system instead of debugging
RefDB. Therefore I suggest to close this bug for the time
being. Whenever you can reproduce this behaviour on a
different system, feel free to open the bug report again.

BTW I assume you have tried the obvious, like rebuilding
/reinstalling RefDB and all libraries it depends on.

----------------------------------------------------------------------

Comment By: Dominik (dreusser)
Date: 2006-09-07 14:19

Message:
Logged In: YES
user_id=1572139

I still get similar errors with the 0.9.8-pre3 version on
the same system. Importing works on a different system which
I just set up. Either we'll drop the issue or I can provide
you an account on my "broken" system.

----------------------------------------------------------------------

Comment By: Markus Hoenicka (mhoenicka)
Date: 2006-09-02 01:36

Message:
Logged In: YES
user_id=85809

I've never encountered problems like this one on any of my
installations. To make sure I've installed 0.9.8-pre3 (the
only difference to pre2 is the inclusion of two headers in
refdbdgetref.c to avoid compiler errors) on a pristine
Debian 3.1 box. I can import your test data without any
problems.

I'll post a message to the refdb-users list to see whether
anyone else has seen this. Unless we can pin down the
environment or the circumstances that lead to this problem,
I'll not be able to fix it.


----------------------------------------------------------------------

Comment By: Dominik (dreusser)
Date: 2006-09-01 15:33

Message:
Logged In: YES
user_id=1572139

It is not just while adding chapters. But I haven't found
out when addref fails exactly..

----------------------------------------------------------------------

You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1550514&group_id=26091
SourceForge.net
2006-09-08 14:06:09 UTC
Permalink
Bugs item #1550514, was opened at 2006-09-01 15:15
Message generated for change (Comment added) made by dreusser
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1550514&group_id=26091

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: refdbd
Group: None
Status: Closed
Resolution: Works For Me
Priority: 5
Submitted By: Dominik (dreusser)
Assigned to: Markus Hoenicka (mhoenicka)
Summary: Trouble while importing chapters

Initial Comment:
Queries are not assembled correctly (cutting of either
the refdb_title or redb_booktitile) while importing
chapters from a file with multiple records. For some
reason, writing the records to a seprate file and
importing from there works for some records. I attached
a file with example records that failed.


Example 1
----------
UPDATE t_refdb SET refdb_pubyear=2003, refdb_secyear=0,
refdb_pyother_info='///', refdb_secother_info=NULL,
refdb_citekey='Bardsley2003a', refdb_user1=NULL,
refdb_user2='schaeffli', refdb_user3=NULL,
refdb_user4=NULL, refdb_user5=NULL, refdb_misc1=NULL,
refdb_misc2=NULL, refdb_misc3=NULL, refdb_issn=NULL,
refdb_issue=NULL, refdb_publisher='IAHS Publication no.
281', refdb_city='Wallingford, Oxfordshire UK',
refdb_volume=NULL, refdb_endpage='74',
refdb_startpage='67', refdb_type='CHAP',
refdb_booktitle='Water resources systems - hydrological
risk, management and development (Proceedings of an
international symposium the XXIII General Assembly of
the International Union of Geodesy and Geophysics, at
Sapporo, Japan, from 30 June to 11 July 2003)',
refdb_title='An approach to creating lumped-parameter
rainfall-runoff models for drainage basins experiencing
envrionemental WHERE refdb_id=2393
1064: You have an error in your SQL syntax; check the
manual that corresponds to your MySQL server version
for the right syntax to use near ''An approach to
creating lumped-parameter rainfall-runoff models
inserting reference data failed

Example 2
---------
UPDATE t_refdb SET refdb_pubyear=1998, refdb_secyear=0,
refdb_pyother_info='///', refdb_secother_info=NULL,
refdb_citekey='Aizen1998', refdb_user1=NULL,
refdb_user2='schaeffli', refdb_user3=NULL,
refdb_user4=NULL, refdb_user5=NULL, refdb_misc1=NULL,
refdb_misc2=NULL, refdb_misc3=NULL, refdb_issn=NULL,
refdb_issue=NULL, refdb_publisher='IAHS Publication No.
248', refdb_city='Wallingford, Oxfordshire UK',
refdb_volume=NULL, refdb_endpage='198',
refdb_startpage='191', refdb_type='CHAP',
refdb_booktitle='Hydrology, Water Resources and Ecology
in Headwaters (P, refdb_title='Estimation of glacial
runoff to the Tarim River, central Tien Shan' WHERE
refdb_id=2352
1064: You have an error in your SQL syntax; check the
manual that corresponds to your MySQL server version
for the right syntax to use near 'Estimation of glacial
runoff to the Tarim River, central Tien Sh
inserting reference data failed

refdb-bug:
Linux aare 2.6.17-1-686 #1 SMP Sat Jul 29 15:32:47 UTC
2006 i686 GNU/Linux
RefDB binaries and scripts in the path:
/usr/bin/refdbd
/usr/bin/refdba
/usr/bin/refdbc
/usr/bin/refdbib
/usr/bin/bib2ris
and their version numbers:
refdbd 0.9.8-pre2
refdba 0.9.8-pre2
refdbc 0.9.8-pre2
refdbib 0.9.8-pre2
/usr/bin/refdb-bug: line 41: nmed2ris: command not found
bib2ris 0.9.8-pre2
DSSSL engines in the path:
and their version numbers:

$REFDBLIB is /usr/share/refdb
global refdbd config file:
refdblib /usr/share/refdb
serverip localhost
dbsport 3306
dbserver mysql
dbpath /var/lib/refdb/db
port 9734
logfile /var/log/refdbd.log
logdest file
loglevel info
pidfile /var/run/refdbd.pid
remoteadmin f
remoteconnect f
keep_pnames t
keyword_scan t
db_encoding
in_encoding UTF-8

global refdba config file:
serverip 127.0.0.1
port 9734
pager less
username joeuser
passwd <protected>
logdest file
loglevel info
logfile /var/log/refdba.log

global refdbc config file:
serverip 127.0.0.1
port 9734
pager less
username joeuser
passwd <protected>
logdest file
loglevel info
logfile /var/log/refdbc.log
cssurl /usr/share/refdb/css/refdb.css
fromencoding UTF-8
toencoding UTF-8

global refdbc config file (cgi):

global refdbib config file:

global nmed2ris config file:

global bib2ris config file:

$HOME is /home/dreusser
user refdba config file:

user refdba config file (hidden):
serverip 127.0.0.1
username root
passwd <protected>
pager less
toencoding ISO-8859-1
fromencoding ISO-8859-1

user refdbc config file:

user refdbc config file (hidden):
serverip 127.0.0.1
username dominik
passwd <protected>
defaultdb hykli
pager less
toencoding ISO-8859-1
fromencoding ISO-8859-1

user refdbib config file:

user refdbib config file (hidden):
serverip 127.0.0.1
username dominik
passwd <protected>
defaultdb refdb_test
pager less
toencoding ISO-8859-1

user nmed2ris config file:

user nmed2ris config file (hidden):

user bib2ris config file:

user bib2ris config file (hidden):
logfile bib2ris.log
logdest 2
loglevel 7
nsf_abstract N2
nsf_url UR
nsf_url2 UR
nsf_pdf UR
nsf_keywords KW
nsf_owner U2
nsf_comment U3
nsf_issn SN


----------------------------------------------------------------------
Comment By: Dominik (dreusser)
Date: 2006-09-08 16:06

Message:
Logged In: YES
user_id=1572139

I agree that the problem probably is related to my box.
Sorry for taking up your time...

----------------------------------------------------------------------

Comment By: Markus Hoenicka (mhoenicka)
Date: 2006-09-07 20:57

Message:
Logged In: YES
user_id=85809

I've sent this problem to the user list without any
response. I reckon that this is not a general problem, but a
problem on a particular (probably screwed-up) box. I'm
afraid that trying to debug this on the affected box is
above my head, as the code that assembles the query strings
is fairly straightforward and not likely to fail just so. We
might end up debugging your system instead of debugging
RefDB. Therefore I suggest to close this bug for the time
being. Whenever you can reproduce this behaviour on a
different system, feel free to open the bug report again.

BTW I assume you have tried the obvious, like rebuilding
/reinstalling RefDB and all libraries it depends on.

----------------------------------------------------------------------

Comment By: Dominik (dreusser)
Date: 2006-09-07 14:19

Message:
Logged In: YES
user_id=1572139

I still get similar errors with the 0.9.8-pre3 version on
the same system. Importing works on a different system which
I just set up. Either we'll drop the issue or I can provide
you an account on my "broken" system.

----------------------------------------------------------------------

Comment By: Markus Hoenicka (mhoenicka)
Date: 2006-09-02 01:36

Message:
Logged In: YES
user_id=85809

I've never encountered problems like this one on any of my
installations. To make sure I've installed 0.9.8-pre3 (the
only difference to pre2 is the inclusion of two headers in
refdbdgetref.c to avoid compiler errors) on a pristine
Debian 3.1 box. I can import your test data without any
problems.

I'll post a message to the refdb-users list to see whether
anyone else has seen this. Unless we can pin down the
environment or the circumstances that lead to this problem,
I'll not be able to fix it.


----------------------------------------------------------------------

Comment By: Dominik (dreusser)
Date: 2006-09-01 15:33

Message:
Logged In: YES
user_id=1572139

It is not just while adding chapters. But I haven't found
out when addref fails exactly..

----------------------------------------------------------------------

You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=385991&aid=1550514&group_id=26091
Continue reading on narkive:
Loading...