Quarto book: HELP WANTED

[friendly]

Description

[Env: Windows 10, Quarto 1.5.53]

I'm not sure this is an appropriate place to make this request, but I can't think of a better one. If inappropriate and you have an idea, please let me know.

I'm working on a new book, Visualizing Multivariate Data and Models in R using Quarto to be published by CRC Press and am running into a considerable number of problems trying to produce a LaTeX/PDF version, no less customize this to my desired.

I'm looking for someone I can hire on a short contract basis to help with this because this is more help than I can ask from the wonderful staff who maintain this discussion list.

For background, I wrote a previous book Discrete Data Analysis with R; (see the online version)
using .Rnw format, where I was able to customize the CRC Press krantz.cls style considerably to achieve a nice looking book, that I could supply in camera-ready format, complete with visual tables of contents and indices for Subject, Author, Examples.

In the new book, using Quarto, I can easily produce an HTML version and publish this to a GitHub site, but I can't even get a LaTeX/PDF version to build reliably.

Problems I need help with

• I'm using Windows 10, where MikTeX was always my LaTeX system. I was able to install LaTeX packages into a localtexmf directory and be prompted by MikTeX to install/update packages.

Quarto doesn't seem to support MikTeX for this purpose, but prefers tinytex based on the TexLive distribution. A main problem I've run into is that the TexLive package manager, tlmgr doesn't work on my system, so latex packages needed cannot be installed, and the PDF compilation fails.

• I have ideas for the book design in LaTeX that go beyond what is provided by the default krantz.cls style. These include extensive use of color in the text, custom section headers and callouts, ...

• HTML and PDF output: CRC Press allows me to have an online version of the book and there I can include, e.g., animated GIF images that would not be part of the printed version.
  I need some help with setting things up so that some text and figures can be done differently in the HTML and PDF versions.

I'm estimating that solving the TexLive problem would be short, but I'd like some help with the other problems, perhaps 10-20 hours.

[mcanouil]

Quick thought about the environment issue: have you considered using Windows Subsystem Linux (WSL) or Devcontainer (Docker)? Mostly via Visual Studio Code which natively supports those environments. (Positron might work as well but I did not try it yet)

For the HTML/PDF, conditional contents is there for that.
Depending on the complexity, you might generate all the different components in the code cells, then use conditional contents to include the components previously generated.

[mcanouil]

I forgot to mention: I'm available (it depends mostly on the amount of time required) for hire as a contractor but I'm not a LaTeX expert.

[friendly]

Thanks for the offer. Could we chat about this via email? I'm mailto:[email protected]

[mcanouil]

Sorry, I missed that message.
If you still need extensive help thus few hours of time, you can email me on my public email that you can find on my personal site.

[friendly]

Thx for the reply. On the environment: it is way too complex for me to consider such a fundamental change to my work. I'm happy with RStudio (2024.09.0+375).

I do know about HTML/PDF conditional contents and have used these in some places. But I've got to get LaTeX working with this project.

[mcanouil]

I do know about HTML/PDF conditional contents and have used these in some places. But I've got to get LaTeX working with this project.

Not sure to understand the issue.
Maybe you could share a more concrete simple use case for this?

On the environment: it is way too complex for me to consider such a fundamental change to my work. I'm happy with RStudio (2024.09.0+375).

Switching to VSCode or Positron (plus using WSL/Devcontainer) is indeed not a small leap to make.
It has advantages considering current state of the technology (AI, containers, etc.) but still a learning curve.

Link to Positron in case you are curious about the new IDE made by Posit: https://github.com/posit-dev/positron

[cderv]

Hi @friendly !

I'm looking for someone I can hire on a short contract basis to help with this because this is more help than I can ask from the wonderful staff who maintain this discussion list.

I remember when writing a book with them, we could ask some TeX question their help desk. At the time they had some issue in the .cls file provided that needed to be solved (but it was written with bookdown not Quarto). Though we needed to ask them .tex question and not Quarto question.

Looking for help to hire, I am not sure the Quarto forum as a place for such thing to be visible; So I hope you'll find some help but you should also try to ask elsewhere too.

using .Rnw format, where I was able to customize the CRC Press krantz.cls style considerably to achieve a nice looking book, that I could supply in camera-ready format, complete with visual tables of contents and indices for Subject, Author, Examples.

krantz.cls still need to be used with Quarto. So you should be able to do the same. You could also with Quarto, if you are more at ease with it, replace all partials and even the whole template. Doc is a bit hidden here: https://quarto.org/docs/journals/templates.html#latex-partials
Source file we use are here: https://github.com/quarto-dev/quarto-cli/tree/main/src/resources/formats/pdf/pandoc with the template used by Quarto here: https://github.com/quarto-dev/quarto-cli/blob/main/src/resources/formats/pdf/pandoc/template.tex

This is the one that will be used to create the final .tex and load different partials (e.g. $doc-class.tex()$ means to load in template doc-class.tex file.)
You can make a copy of this whole template and tweak, or just provides customized partials. Then configure format: pdf to use them

I'm using Windows 10, where MikTeX was always my LaTeX system. I was able to install LaTeX packages into a localtexmf directory and be prompted by MikTeX to install/update packages.

Yes - if you let Quarto build the PDF for you, then it is not possible to let MikTeX prompt you as a user. Quarto + TinyTeX does have support for automatic package installation when missing, but it does not prompt. I don't know if you can configure MikTeX that way.

If you are confortable with LaTeX compilation, and you wan't to do that yourself, you should also be able to let Quarto produce a .tex file only (format: latex), and then you can do your PDF rendering manually in a following step that you have full control over.

However, just to be clear, MikTeX is supported. Just not the prompt to user for missing packages. So all required packages should be available beforehand when you'll run a quarto render
But you don't have to switch to TeX Live if you don't want too.

A main problem I've run into is that the TexLive package manager, tlmgr doesn't work on my system, so latex packages needed cannot be installed, and the PDF compilation fails.

If you want help for TinyTeX to run on your system, please do open a discussion at https://github.com/rstudio/tinytex and I'll be happy to help

I have ideas for the book design in LaTeX that go beyond what is provided by the default krantz.cls style. These include extensive use of color in the text, custom section headers and callouts, ...

I am no LaTeX expert here, so I am not sure where those modification should be done. I have already mentioned some options above, but this make me thing also about what you can do inside the document.

• You can using Raw Tex block if you need - this will just have to be handled with your HTML version, probably with conditional as mentioned.
• We have an extension so that you can use Markdown syntax to create LaTeX environment for what you need (https://github.com/quarto-ext/latex-environment/). This could allow you do advanced LaTeX while keeping a syntax that you could also handle with HTML format (div or span with classes would be created.)

HTML and PDF output: CRC Press allows me to have an online version of the book and there I can include, e.g., animated GIF images that would not be part of the printed version.
I need some help with setting things up so that some text and figures can be done differently in the HTML and PDF versions.

As mentioned conditional content is helpful here to remove content in some output format and not others.

If you are using knitr engine to create some figures or HTML rendering, know that it should handle non HTML content by trying to make a screenshot of the interactive figure using webshot2 or webshot R package. There is also feature to condition your computation based on output format

• https://bookdown.org/yihui/rmarkdown-cookbook/html-widgets.html
• https://bookdown.org/yihui/rmarkdown-cookbook/latex-html.html

I hope this helps. And I wish you to find the hire you are looking for your book. Thanks for using Quarto !!

[friendly]

@cderv
This has been SUPER helpful. Nowhere else have I found detailed info on using Miktex vs TexLive on Windows, and in particular that Miktex is supported, but not the prompt to install missing tex packages. That can be changed in the Miktex console with the option "Prompt for missing package" -- NEVER. (This was never a problem for me before Quarto, when I used knitr, rmarkdown.)

Another gotcha was that installing tinytex did not seem to install the tlmgr package manager on my system. Not sure why, but I suppose a solution would be to [install TexLive directly] (https://www.tug.org/texlive/windows.html).

Yet another is that one cannot easily have two TeX systems on Windows, but it is possible to switch between them by changing their order in the system PATH, as described in this StackExchange question.

It would be great to have a public document on this problem, so I can start a discussion on https://github.com/rstudio/tinytex

[cderv]

Another gotcha was that installing tinytex did not seem to install the tlmgr package manager on my system. Not sure why, but I suppose a solution would be to [install TexLive directly] (tug.org/texlive/windows.html).

This should not happen. It is either an issue on TinyTeX installer or a documentation problem if you did not managed to follow the step.

Yet another is that one cannot easily have two TeX systems on Windows, but it is possible to switch between them by changing their order in the system PATH, as described in this StackExchange question.

It is possible to have different TeX system on Windows. quarto install tinytex does not set the TinyTeX it will install on PATH for that purpose. See https://quarto.org/docs/output-formats/pdf-engine.html#installing-tex

So you could have a TinyTeX for quarto and MikTeX for other usage. if you want to.

It would be great to have a public document on this problem, so I can start a discussion on rstudio/tinytex

Not sure what you meant here... sorry.

[friendly]

Progress report:

I was able to get MikTeX working to compile my book, but it was quite tedious. For the record (or anyone else with this problem):

• Re-install (the latest) MikTex

  • For my user only, NOT for all users: installs to C:\Users\friendly\AppData\Local\Programs
  • Specify YES to "Install missing packages on the fly?"
  • In the MikTeX Console, under Settings -> Directories, add my localtexmf/ to the TEXKMF directories to be searched for .sty, .bib ,,, files by kpsewhich

• In _quarto.yml turn off tinytex, and use include-* files modified from https://github.com/bgreenwell/quarto-crc. Make sure to keep-tex: true

  pdf:
    documentclass: krantz
    classoption: [10pt, krantz2]
    include-in-header: latex/preamble.tex
    include-before-body: latex/before-body.tex
    include-after-body: latex/after-body.tex
    keep-tex: true
    latex-tinytex: false
    geometry:
      - top=20mm
      - left=25mm
    code-block-bg: 'E8FFFF'  #'#f1f1f1'

• In RStudio, from Build -> Render Book -> PDF Format I get a ton of WARNINGs ([WARNING] Macro '\mat' already defined, ignoring at line 4556 column 1) but then compilation fails at the first latex ERROR

Rendering PDF
running xelatex - 1
  This is XeTeX, Version 3.141592653-2.6-0.999996 (MiKTeX 24.4) (preloaded format=xelatex.fmt)
   restricted \write18 enabled.
  entering extended mode
  
updating tlmgr

updating existing packages
ERROR: 
compilation failed- error
Package xcolor Error: Undefined color `darkgreen'.

See the xcolor package documentation for explanation.
Type  H <return>  for immediate help.
 ...                                              

• Open the index.tex file in TeXStudio.
  • Fix the LaTeX error (darkgreen is not defined in the xcolor package. I fix that using \definecolor{darkgreen}{RGB}{1,50,32}.
  • Compile again to resolve cross-references, build the table of contents
  • Run Tools -> Index (makeindex) to build the index
  • Compile again.

Questions:

Note that TeXStudio uses pdflatex.exe -synctex=1 -interaction=nonstopmode "index".tex so it doesn't stop at the first error. Is there any way to use nonstopmode in the RStudio compile?

Clearly, I need a Makefile for this, but I'm not sure how to specify one that I can run from RStudio.

How can I change the name of the output files from index.tex, index.pdf, ...? I tried this, to no effect:

book:
  title: "Visualizing Multivariate Data and Models in R"
  output-file: "Vis-MLM"

[cderv]

Note that TeXStudio uses pdflatex.exe -synctex=1 -interaction=nonstopmode "index".tex so it doesn't stop at the first error. Is there any way to use nonstopmode in the RStudio compile?

Do you mean when doing In RStudio, from Build -> Render Book -> PDF Format ?

if you use RStudio to build to PDF through Quarto, this is really Quarto calling TeX engine for you.
Quarto has some option your can set for the engine - See https://quarto.org/docs/output-formats/pdf-engine.html#alternate-pdf-engines

So you could pass any flag you want.

Just so you know, we did our best to make the LaTeX PDF experience as smooth as possible thanks to TinyTeX integration. When you opt out of it, it will be more advanced and manual, but I believe we offer entry point for configuration.

You shouldn't have to open a index.tex in TeXStudio to have a PDF render from a Quarto project really.

Happy to work with you to make your project work with Quarto.

[friendly]

Thanks @cderv for continuing to follow up, & for the link to the PDF-engine docs. I'm glad your team is working toward more seamless LaTeX/PDF integration and will give TinyTeX another whirl when I get a chance.

I want to express my general thanks to all the Quarto-dev folks who respond helpfully to many, many queries.

[vincentarelbundock]

@friendly I am also writing a book for CRC and have gotten the PDF to build. It was quite tricky, dealing with lots of "partials", but it seems to work OK for now.

I'm happy to share the files and chat a bit if you think that would be helpful.

You can reach me at my Université de Montréal email, easily findable on the web.

[friendly]

Thanks so much, Vincent. I'll contact you by email.

[baptiste]

I also got their template to work last year despite obnoxious incompatibility with hyperref (and useless tech support). However, with Taylor and Francis' recent "strategy" to surreptitiously sell out the work of their authors "for the benefit of LLMs", I am considering ditching them and sticking with my online version, and publishing elsewhere the pdf with a template that actually looks good (theirs is too narrow for good multi-panel figures).

https://pivot-to-ai.com/2024/07/20/taylor-francis-feeds-academics-work-to-microsoft-ai/

(sorry for the sidenote rant, but I wanted to share my experience with their Latex "support" and now this pathetic development)