[tex-k] texLive 2011 updmap problem

[Dick Nickalls]

Dear Karl,

just a note to report a problem wrt updmap in TL 2011, and to ask for some advice as to how to get it working. I can't see any related info on the internet anywhere.

I have just installed TL2011 in my linux (mandriva) distro (TL 2007, 2008, 2009, 2010 all installed OK)
All is working just fine - but I have discovered that the updmap command fails for some reason.
/texlive/2011/bin/i386-linux/updmap

Here is the error message from running it at the commandline

-----------------
$ updmap
--> Error in option spec: "setoption=s{1,2}"
------------------------

I notice that for the first time it is a link to updmap.pl
in /texmf/scripts/tetex/updmap.pl
(in all previous years TL it was a BASH script, which worked nicely OK)

my question is
(1) can I use the 2010 updmap.sh script instead ??
(2) what is the problem with the new perl script
(3) where do I find any /recent/ documentation regarding updmap

any help would be appreciated.


regards,
Dick

---------
Dr RWD Nickalls
Consultant in Anaesthesia & Intensive Care (retired),
c/o Department of Anaesthesia
Nottingham University Hospitals
City Hospital Campus
Hucknall Road
Nottingham NG5 1PB
UK

tel: [phone]
email: dick at nickalls.org
web: http://www.nickalls.org/dick/
mobile: [phone]

[Norbert Preining]

Hi Dick,

Post by Dick Nickalls
--> Error in option spec: "setoption=s{1,2}"

Your installation of perl is *way* too old. The support for this
specification has been introduced about 8 (AFAIR) years ago.

Post by Dick Nickalls
(1) can I use the 2010 updmap.sh script instead ??

Yes.

Post by Dick Nickalls
(2) what is the problem with the new perl script

No problem, you have an old perl.

Post by Dick Nickalls
(3) where do I find any /recent/ documentation regarding updmap

There is no /recent/ documentation, the perl script is an old implementation
that was originally used on Windows only, but we use it also on Unix
now since it is way faster and we do want to have only one script to care for.

Best wishes

Norbert
------------------------------------------------------------------------
Norbert Preining preining@{jaist.ac.jp, logic.at, debian.org}
JAIST, Japan TeX Live & Debian Developer
DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
WRABNESS (n.)
The feeling after having tried to dry oneself with a damp towel.
--- Douglas Adams, The Meaning of Liff

[Norbert Preining]

Hi Dick

first of all, please stay on list. Private replies does not help anyone.

OK- this is news to me indeed. - I use Perl a lot and this TL application is the /only/ one where my version fails just now !

Really? Then you don't use Getopt often. I happen to use this construct
quite often.

in fact my Perl version is v5.8.7 (2005)

You need 5.8.8 (AFAIR)

I would be glad if TL could consider maintaining a BASH version in parallel ---for a few years at least if possible -

Sorry, but no. We will not continue maintaining a script just because
a few people prefer to run very old perl. You can even update *only*
Getopt::Long and it will work. I am not very much inclined to keep
backward compatibility for ages, not even latex keeps it, even less
packages of latex.

--certainly some rather detailed info on this aspect of TL's use of Perl ought to be made easily available on the TL website etc, and in all the info with 2011 TL as well.

We will add a check in the updmap script and die early with a warning
that perl is too old and you need 5.8.8.

perhaps some updated info could be posted on the TL website ?

As Reinhard wrote, there is no updated info.

and also ? include a Perl status check in the useful LTxcheck utility perhaps

Never heard of
LTxcheck
???

I forgot to ask you which is the minimum version of Perl required for TL
Perl tools used gnu-Linux systems???

See above.

Best wishes

Norbert
------------------------------------------------------------------------
Norbert Preining preining@{jaist.ac.jp, logic.at, debian.org}
JAIST, Japan TeX Live & Debian Developer
DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
Now it is such a bizarrely improbable coincidence that
anything so mindboggingly useful could have evolved purely
by chance that some thinkers have chosen to see it as the
final and clinching proof of the non-existence of God.
The argument goes something like this: `I refuse to prove
that I exist,' says God, `for proof denies faith, and
without faith I am nothing.'
The Babel fish is a dead giveaway, isn't
it? It could not have evolved by chance. It proves you
exist, and so therefore, by your own arguments, you don't.
QED.'
--- Douglas Adams, The Hitchhikers Guide to the Galaxy

[Tom Rokicki]

Is there no way we can't make that script compatible with older perls?

There are a *lot* of older Perls out there. What is it about this particular
script that requires 5.8.8?

Post by Norbert Preining
Hi Dick
first of all, please stay on list. Private replies does not help anyone.

OK- this is news to me indeed. - I use Perl a lot and this TL application is the /only/ one where my version fails just now !

Really? Then you don't use Getopt often. I happen to use this construct
quite often.

in fact my Perl version is v5.8.7 (2005)

You need 5.8.8 (AFAIR)

I would ?be glad if ?TL could consider maintaining a BASH version ?in parallel ---for a few years at least if possible -

Sorry, but no. We will not continue maintaining a script just because
a few people prefer to run very old perl. You can even update *only*
Getopt::Long and it will work. I am not very much inclined to keep
backward compatibility for ages, not even latex ?keeps it, even less
packages of latex.

--certainly some rather detailed info on this aspect of TL's use of Perl ought to be made easily available on the TL ?website etc, and in all the info with 2011 TL as well.

We will add a check in the updmap script and die early with a warning
that perl is too old and you need 5.8.8.

perhaps some updated info could be posted on the TL website ?

As Reinhard wrote, there is no updated info.

and also ? include a Perl status check in the ?useful LTxcheck utility perhaps

Never heard of
? ? ? ?LTxcheck
???

I forgot to ask you which is the minimum version of Perl required for TL
?Perl tools ? used ? gnu-Linux systems???

See above.
Best wishes
Norbert
------------------------------------------------------------------------
JAIST, Japan ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? TeX Live & Debian Developer
DSA: 0x09C5B094 ? fp: 14DF 2E6C 0307 BE6D AD76 ?A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
Now it is such a bizarrely improbable coincidence that
anything so mindboggingly useful could have evolved purely
by chance that some thinkers have chosen to see it as the
final and clinching proof of the non-existence of God.
The argument goes something like this: `I refuse to prove
that I exist,' says God, `for proof denies faith, and
without faith I am nothing.'
The Babel fish is a dead giveaway, isn't
it? It could not have evolved by chance. It proves you
exist, and so therefore, by your own arguments, you don't.
QED.'
? ? ? ? ? ? ? ? --- Douglas Adams, The Hitchhikers Guide to the Galaxy

[Norbert Preining]

Post by Tom Rokicki
There are a *lot* of older Perls out there. What is it about this particular
script that requires 5.8.8?

Getopt::Long specification format
s{1,2}
which means that an option takes either one or two arguments of type string.

This is to keep perfect compatibility with bash and windows versions of
updmap distributed for 15+ years.

I am not sure if that can be easily programmed around.

Best wishes

Norbert
------------------------------------------------------------------------
Norbert Preining preining@{jaist.ac.jp, logic.at, debian.org}
JAIST, Japan TeX Live & Debian Developer
DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
RAMSGATE (n.)
All institutional buildings must, by law, contain at least twenty
ramsgates. These are doors which open the opposite way to the one you
expect.
--- Douglas Adams, The Meaning of Liff

[Dick Nickalls]

Norbert,

Post by Norbert Preining
first of all, please stay on list. Private replies does not help anyone.

OK - do you want me to send a copy of this to tex-live at tug.org then so we can follow it there? I don't quite understand the tex-k at ... list (its not listed on the TL mail list at tug as far as I can see.

Post by Norbert Preining

OK- this is news to me indeed. - I use Perl a lot and this TL application is the /only/ one where my version fails just now !

Really? Then you don't use Getopt often. I happen to use this construct
quite often.

well - I /do/ use Getopt::Long, and it /does/ work nicely with Perl v 5.8.7

Post by Norbert Preining

and also ? include a Perl status check in the useful LTxcheck utility perhaps

Never heard of
LTxcheck
???

well the utility ltxcheck.tex is on TL2011 at
../texmf-dist/tex/latex/base/ltxcheck.tex
and it runs a useful general check on installed tools etc.


BTW - as regards the requirement for Perl 5.8.8. or later,
is this particular specification
defined somewhere in the documentation anywhere?
- ie does this apply to all the other very many perl scripts which have appeared in /bin/i386-linux over the last few years??


anyway - I appreciate the efforts of tom and others to look into whether the bash scripts can be supported - I hope this can be done without too much difficulty.

regards,
Dick
---------
Dr RWD Nickalls
Consultant in Anaesthesia & Intensive Care (retired),
c/o Department of Anaesthesia
Nottingham University Hospitals
City Hospital Campus
Hucknall Road
Nottingham NG5 1PB
UK

tel: [phone]
email: dick at nickalls.org
web: http://www.nickalls.org/dick/
mobile: [phone]

On Sat, 3 Sep 2011 01:22:17 +0900

Post by Norbert Preining
Hi Dick
first of all, please stay on list. Private replies does not help anyone.

OK- this is news to me indeed. - I use Perl a lot and this TL application is the /only/ one where my version fails just now !

Really? Then you don't use Getopt often. I happen to use this construct
quite often.

in fact my Perl version is v5.8.7 (2005)

You need 5.8.8 (AFAIR)

I would be glad if TL could consider maintaining a BASH version in parallel ---for a few years at least if possible -

Sorry, but no. We will not continue maintaining a script just because
a few people prefer to run very old perl. You can even update *only*
Getopt::Long and it will work. I am not very much inclined to keep
backward compatibility for ages, not even latex keeps it, even less
packages of latex.

--certainly some rather detailed info on this aspect of TL's use of Perl ought to be made easily available on the TL website etc, and in all the info with 2011 TL as well.

We will add a check in the updmap script and die early with a warning
that perl is too old and you need 5.8.8.

perhaps some updated info could be posted on the TL website ?

As Reinhard wrote, there is no updated info.

and also ? include a Perl status check in the useful LTxcheck utility perhaps

Never heard of
LTxcheck
???

I forgot to ask you which is the minimum version of Perl required for TL
Perl tools used gnu-Linux systems???

See above.
Best wishes
Norbert
------------------------------------------------------------------------
JAIST, Japan TeX Live & Debian Developer
DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
Now it is such a bizarrely improbable coincidence that
anything so mindboggingly useful could have evolved purely
by chance that some thinkers have chosen to see it as the
final and clinching proof of the non-existence of God.
The argument goes something like this: `I refuse to prove
that I exist,' says God, `for proof denies faith, and
without faith I am nothing.'
The Babel fish is a dead giveaway, isn't
it? It could not have evolved by chance. It proves you
exist, and so therefore, by your own arguments, you don't.
QED.'
--- Douglas Adams, The Hitchhikers Guide to the Galaxy

[Reinhard Kotucha]

Post by Dick Nickalls
Dear Karl,
just a note to report a problem wrt updmap in TL 2011, and to ask
for some advice as to how to get it working. I can't see any
related info on the internet anywhere.
I have just installed TL2011 in my linux (mandriva) distro (TL
2007, 2008, 2009, 2010 all installed OK) All is working just fine -
but I have discovered that the updmap command fails for some
reason. /texlive/2011/bin/i386-linux/updmap
Here is the error message from running it at the commandline
-----------------
$ updmap
--> Error in option spec: "setoption=s{1,2}"
------------------------
I notice that for the first time it is a link to updmap.pl in
/texmf/scripts/tetex/updmap.pl (in all previous years TL it was a
BASH script, which worked nicely OK)

Dear Dick,
I'm on this list too, hence it wasn't necessary to write me separately.

Post by Dick Nickalls
my question is
(1) can I use the 2010 updmap.sh script instead ??

Yes, but the shell script is about 30 times slower and will not be
maintained anymore. There are also known problems with spaces in file
names.

BTW, the Perl script isn't really new. I has been used in TeX Live
under Windows for more than a decade. I made it work on Unix when I
was too annoyed by the very low speed of the shell script. The Perl
script now also provides a more useful log file.

Post by Dick Nickalls
(2) what is the problem with the new perl script

You are using a relatively old version of Perl, presumably 5.8.4.
updmap.pl requires at least version 5.8.8. Upgrading Perl is the best
solution.

Post by Dick Nickalls
(3) where do I find any /recent/ documentation regarding updmap

updmap hasn't been changed for many years, hence both, the manual page
and the help message should be up-to-date.

Regards,
Reinhard

[Karl Berry]

Is there no way we can't make that script compatible with older perls?

There may be a way (while losing perfect compatibility). Namely detect
the older perl and then change the getopt parsing to only support one
arg to setoption (or something like that) with the standard features. I
don't know if that approach can actually be made to work, and requires
more time. I haven't gotten back to it. If someone can send a patch,
that would be good.

There are a *lot* of older Perls out there.

Tom, of course I was very well aware of this. I am usually the last
person in the world to drop umpteen--year-compatibility, but in this
case all the other options were worse. I wrote more details on the
tex-live list when it was reported earlier. (So far these are the only
two reports.) http://tug.org/pipermail/tex-live/2011-July/029764.html

I am puzzled about the 5.8.4 vs. 5.8.8 discrepancy. When I looked at it
originally, I apparently found that the getopt feature was added in
5.8.4. But with reports that it actually requires 5.8.8, that means
we're up to 2006 for the perl release :(.

k

[Norbert Preining]

Post by Tom Rokicki
Is there no way we can't make that script compatible with older perls?

Yes, there is, I just programmed around it.

Reinhard, or anyone else, could you please test the following patch,
preferrably on both Windows and Unix machines:

Index: updmap.pl
===================================================================
--- updmap.pl (revision 23775)
+++ updmap.pl (working copy)
@@ -200,6 +200,20 @@
# process cmd line options
#
sub processOptions {
+ my $oldconfig = Getopt::Long::Configure(qw(pass_through));
+ sub read_set_options {
+ my ($opt, $val) = @_;
+ # check if = occurs in $val, if not, get the next argument
+ if ($val =~ m/=/) {
+ push @setoptions, $val;
+ } else {
+ push @setoptions, "$val=" . shift @ARGV;
+ }
+ }
+ GetOptions("setoption=s@" => \&read_set_options) or
+ die "Try \"$0 --help\" for more information.\n";
+ Getopt::Long::Configure($oldconfig);
+
unless (&GetOptions (
"cnffile=s" => \$cnfFile,
"copy" => \$copy,
@@ -217,7 +231,8 @@
"outputdir=s" => \$outputdir,
"pdftexoutputdir=s" => \$pdftexoutputdir,
"q|quiet|silent" => \$quiet,
- "setoption=s{1,2}" => \@setoptions,
+ # handled above
+ #"setoption=s{1,2}" => \@setoptions,
"showoptions=s" => \@showoptions,
"syncwithtrees" => \$syncwithtrees,
"version" => sub { print &version(); exit(0); },


I need more testing but I think we can get it running for all perls.

Best wishes

Norbert
------------------------------------------------------------------------
Norbert Preining preining@{jaist.ac.jp, logic.at, debian.org}
JAIST, Japan TeX Live & Debian Developer
DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
MOFFAT (n. tailoring term)
That part of your coat which is designed to be sat on by the person
next of you on the bus.
--- Douglas Adams, The Meaning of Liff

[Norbert Preining]

Post by Norbert Preining
Reinhard, or anyone else, could you please test the following patch,

Better patch which dies if there is no argument availabl ein the shift
===================================================================
--- updmap.pl (revision 23775)
+++ updmap.pl (working copy)
@@ -200,6 +200,23 @@
# process cmd line options
#
sub processOptions {
+ my $oldconfig = Getopt::Long::Configure(qw(pass_through));
+ sub read_set_options {
+ my ($opt, $val) = @_;
+ # check if = occurs in $val, if not, get the next argument
+ if ($val =~ m/=/) {
+ push @setoptions, $val;
+ } else {
+ my $vv = shift @ARGV;
+ die "Try \"$0 --help\" for more information.\n"
+ if !defined($vv);
+ push @setoptions, "$val=$vv";
+ }
+ }
+ GetOptions("setoption=s@" => \&read_set_options) or
+ die "Try \"$0 --help\" for more information.\n";
+ Getopt::Long::Configure($oldconfig);
+
unless (&GetOptions (
"cnffile=s" => \$cnfFile,
"copy" => \$copy,
@@ -217,7 +234,8 @@
"outputdir=s" => \$outputdir,
"pdftexoutputdir=s" => \$pdftexoutputdir,
"q|quiet|silent" => \$quiet,
- "setoption=s{1,2}" => \@setoptions,
+ # handled above
+ #"setoption=s{1,2}" => \@setoptions,
"showoptions=s" => \@showoptions,
"syncwithtrees" => \$syncwithtrees,
"version" => sub { print &version(); exit(0); },

Best wishes

Norbert
------------------------------------------------------------------------
Norbert Preining preining@{jaist.ac.jp, logic.at, debian.org}
JAIST, Japan TeX Live & Debian Developer
DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
OUNDLE (vb.)
To walk along leaning sideways, with one arm hanging limp and dragging
one leg behind the other. Most commonly used by actors in amateur
production of Richard III, or by people carrying a heavy suitcase in
one hand.
--- Douglas Adams, The Meaning of Liff

[Reinhard Kotucha]

Post by Norbert Preining
Reinhard, or anyone else, could you please test the following patch,

It works fine on my machine.

$ uname -a
Linux zaphod 2.6.30-gentoo-r5 #10 SMP Tue Aug 30 22:25:23 CEST 2011 x86_64 AMD Athlon(tm) 64 X2 Dual Core Processor 4800+ AuthenticAMD GNU/Linux

$ perl --version
This is perl 5, version 12, subversion 3 (v5.12.3) built for x86_64-linux

However, I failed to compile Perl 5.8.4. The Configure script creates
a broken Makefile. Same with 5.8.3. I don't have the time to debug
broken configure scripts, so someone else has to test it with an older
version of Perl. Curiously enough, compiling the latest release works
like a charm.

I'll test it on a Windows machine on Monday.

Thanks for the patch,
Reinhard

[Karl Berry]

Hi Dick,

Many different points are being raised.

tex-k at tug.org is a public list, listed on
http://tug.org/mailman/listinfo. I did not have any terribly convincing
reason to put tex-k into the --help message of updmap and other such
utilities, I just wanted to.

The sh (it was never bash-specific) updmap is not going to be supported
going forward (by us, anyway). That be a big step backward.

Happily, Norbert already wrote a patch for Perl version to avoid the
s{1,2} usage that I used. It will be in tonight's update. I'll attach
it here. I know already that further changes will be coming but as far
as I can tell this version is usable. If you have problems, let us know.

Reinhard, you can test with /usr/local/bin/perl5.8.1 on tug.org, if you
want. The script started up ok with it, I didn't do much beyond that.

The (no-longer-extant) 5.8.8 requirement was not specifically
documented; what was documented was the change to using the Perl updmap
everywhere, so at least there was a clue that there might be issues.
(As I've said already, I thought it was 5.8.4, anyway.)

No such requirement can globally apply, since scripts are written by
different people at different times in different languages for different
reasons. Just talking about the ones we maintain, they should work with
any reasonable version. I have no way to know exactly which ones.

We also have no way to do anything about ltxcheck.tex. That is owned by
the LaTeX group and you could suggest it to them if you like
(http://www.latex-project.org/bugs-upload.html). I don't see any way
they can check anything about Perl, though, and don't know what they
could check for even if they could.

Best,
karl

-------------- next part --------------
A non-text attachment was scrubbed...
Name: updmap.pl
Type: application/octet-stream
Size: 39826 bytes
Desc: not available
URL: <http://tug.org/pipermail/tex-k/attachments/20110904/5260190c/attachment-0001.obj>

[Reinhard Kotucha]

Post by Karl Berry
Reinhard, you can test with /usr/local/bin/perl5.8.1 on tug.org, if
you want. The script started up ok with it, I didn't do much
beyond that.

Works fine with

#! /usr/local/bin/perl5.8.1

on tug.org. This is what I tried:

updmap-sys --setoption dvipsDownloadBase35=true
updmap-sys --setoption dvipsDownloadBase35=false
updmap-sys --setoption dvipsDownloadBase35 true
updmap-sys --setoption dvipsDownloadBase35 false
updmap-sys --setoption=dvipsDownloadBase35=true
updmap-sys --setoption=dvipsDownloadBase35=false
updmap-sys --setoption=dvipsDownloadBase35 true
updmap-sys --setoption=dvipsDownloadBase35 false
updmap-sys --enable Map foo.map
updmap-sys --disable foo.map
updmap-sys --enable=Map foo.map
updmap-sys --disable foo.map
updmap-sys --enable=Map=foo.map
updmap-sys --disable=foo.map

It also works fine under Windows 7.

Regards,
Reinhard

[Dick Nickalls]

Norbert,

It is already gone by now. I have changed updmap so that it does not
require anything special now, should even run with 5.8.4 ...

excellent :-)

If you update your texlive installation today or the following days
you should get an updmap perl script that runs on your computer.

well - Karl sent me a copy of updmap.pl vers 23807, and this works OK with my Mandriva Linux box + TL2011 installed.

however, I notice that it does not generate the
.../texmf-var/fonts/map/dvipdfm/..... stuff
(this /is/ generated by the equiv bash script of TL2010)
so I don't know whether this is as expected or not

anyway - so fa so good - thanks all.

regards,
Dick
---------

On Tue, 6 Sep 2011 08:03:10 +0900

Post by Dick Nickalls
BTW - as regards the requirement for Perl 5.8.8. or later,
is this particular specification
defined somewhere in the documentation anywhere?

It is already gone by now. I have changed updmap so that it does not
require anything special now, should even run with 5.8.4 ...
If you update your texlive installation today or the following days
you should get an updmap perl script that runs on your computer.
Case closed.
Best wishes
Norbert
------------------------------------------------------------------------
JAIST, Japan TeX Live & Debian Developer
DSA: 0x09C5B094 fp: 14DF 2E6C 0307 BE6D AD76 A9C0 D2BF 4AA3 09C5 B094
------------------------------------------------------------------------
DUNBOYNE (n.)
The moment of realisation that the train you have just patiently
watched pulling out of the station was the one you were meant to be
on.
--- Douglas Adams, The Meaning of Liff

[Reinhard Kotucha]

Post by Dick Nickalls
however, I notice that it does not generate the
.../texmf-var/fonts/map/dvipdfm/..... stuff
(this /is/ generated by the equiv bash script of TL2010)
so I don't know whether this is as expected or not

Yes, this is desired. No program within TeX Live is using dvipdfm.map
anymore. dvipdfm is a symlink to dvipdfmx, and the latter is using
pdftex.map. I must admit that I never understood why dvipdfm had its
own map file format.

Regards,
Reinhard