Sorry to reply to myself. I've now found the info about config.xml and how to set up fullscreen mode and my icons.
It's still not (very) clear how I make use of config.xml with Packager. I guess I just create that at the top level of the HTML folder before using Packager...
--Hal