Change Log for GLFPE Linux based on Debian 10 10 Dec 2020 GLF ------------------------------------------------------------------------------------------------------ Each version of GLFPE Linux updates the build suite with latest versions of included repository packages. Some builds add new features over time, some merely update the software as provided by the repositories. GLF strives to update about once per month minimum to keep live boot images up to date, especially for security upgrades. GLFPE is intended to be suitable for public distribution. GLF strives to remove content which may be proprietary or copyrighted content not suitable for public distribution. The content is from free and open sources, including Debian repositories or other open internet content, most under the GPL license, MIT license, BSD license, public domain, or as personally released by GLF. GLFPE is not an official release product of the Debian project, but it uses only content which is contained in Debian repositories or recompiled from source for use on Debian OS. No kernel OS components are otherwise locally altered from the Debian binary repositories. Some open applications may be locally forked and extended by GLF from source code and/or scripts to exhibit custom behavior. The Debian "live build" process is used to build each distribution ISO image, in a manner compatible with the published Debian documentation, though often highly tweaked and customized with additional content. The primary intent of each GLF OS distribution is to provide a fully function OS from live boot which does not need to be permanently installed to a user's local hard drive, though an optional installation process is included which has been successfully tested on both x86-64 (amd64) and 686 (i386) computers. The secondary intent of each distribution is to educate and demonstrate to users how to create personal custom versions of the OS which add or delete core applications or other content in the spirit of open development. The public distribution website includes documentation of any special procedures required. For the most part a user may use this OS entirely from live boot, with any permanent data stored as required only to extenal drives such as USB sticks. Procedures have been developed and documented which allow periodic OS rebuilds to run entirely in live boot sessions, using only temporary external work drives, such that the distribution may be maintained without ever actually installing it locally to a PC. This is indeed the SOP used by GLF to update the released versions. The distribution and its component configurations are maintained and archived to website by GLF for public distribution as a live boot runnable OS. The live build configuration files are also openly distributed such that a user may optionally reproduce, extend, or otherwise modify to derive new custom versions of the distribution. ------------------------------------------------------------------------------------------------------ GLF experimental development on Series 600 began April 2019 and progressed up to official Debian 10 release date. As of September 4, 2019, GLF decided to stop updating series 500 (Debian 9 stretch) to concentrate all future efforts on series 600 (Buster). Series 600 GLFPE versions are currently based on Debian 10 (Buster). Version 631 February 20, 2021 Update dosbox-x from 0.83.6 to 0.83.10 (using .deb file compiled from source). Patches CTRL-F10 mouse capture, and allows cut-paste with clipboard. Update config file for dosbox-x. Version 630 February 1, 2020 Important security updates, including fix for open long-term "sudo" vulnerability. Add "nemiver" package, a GUI for GDB C/C++ debugger. Version 629 December 10, 2020 Update Arduino sample source code to include latest work, Applies to GLFPE 64 and 32 bit and GPERS 64 bit. Update latest GLFPE sample source, including beginning work on "garyos" under ardport, and minor changes to libraries. GLFPE sample codebase is now consistent with recently upgraded Raspberry Pi OS image. Update Zoom application on 64 bit GLFPE (update not available for 32 bit). Version 628 November 3, 2020 Add alternate dosbox-x installation via packages.chroot. Extended features over repository version of DOSbox. Compiled from source by GLF and packaged into .deb file using checkinstall. Update Arduino sample source code to include latest work, including trs-port_22. Applies to GLFPE 64 and 32 bit and GPERS 64 bit. Update latest GLFPE sample source, including a (finally) working vuedit program, a locally compiled version of bwbasic, and minor changes to lxmcurses library. Version 627 September 24, 2020 Primarily a minor app and security update with few significant changes to PC applications. Most distribution changes occur to Arduino IDE and Arduino sample source code. The startup script introduced in 626 which requested a password change was improved, so that password entry now happens inside a loop, so that the process will not normally exit until it succeeds. This makes it much more likely that the live boot user will change the password from the widely published default (user=user, password=live). The user may still opt to avoid password change by closing the window, and is so informed. Update Arduino IDE to 1.8.13 and add support for ESP32 microcontroller. Add some new sample source code to support DOIT ESP32 DEVKIT composite video (by bitluni). Arduino IDE was updated by GLF into this and future releases from IDE 1.8.9 to 1.8.13. As usual PJRC Teensy and AVR ATtiny support (by David Mellis) is included in the distro. Also support was added for ESP32 based microcontrollers, with some sample source from "bitluni's" project for composite video which was specifically tested to work on DOIT ESP32 DEVKIT V1. Because the addition of the ESP32 support adds almost 300 Mb to the ".arduino15" folder under the home directory, special measures were taken to force that code into the same scheme used to pack GLFPE sample source code under /usr/share/work/user/ so that it does not consume RAM/disk space in live boot mode. The Arduino IDE works properly upon initial live boot except that ESP32 support is not available immediately. Upon execution of the optional OS menu item "Applications/programming/GPERS-restricted", the sample source code under "~/Arduino" is expanded, and ESP32 support is then immediately available without consuming additional RAM resources. This applies ONLY to the version of expressif ESP32 software built into the distribution. If the usr updates the support using Boards Manager, the updates will override the built in data and several hundered Mb of RAM will be consumed. The script to perform this expansion is hard coded to match the specific version of the ESP32 software, and must be maintained as needed for future distributions. Update Zoom application (in packages.chroot) to version 5.3+ from previous 5.1. (GLFPE 64 bit only) Remove Krita package due to its size (210 Mb) pushing the ISO's 4.3 Gb limit given new priority content for Arduino ESP32. Krita remains in GPERS distribution, which is already too large (5.5 Gb) to fit on DVD or FAT32 anyway, and must be cut to USB stick. Krita is still not available for 32 bit Linux. Version 626 September 9, 2020 Primarily a minor update with few significant changes to applications (added GNU "cflow"), but updates to included sample source code to track recent flurry of development both under /src and /Arduino. Version 626 introduces a new startup script to notify and urge the user to change the default password (always "live" for all Debian Live Boot distros) for the live boot session. This change has been (or will be) ported to all GLF Live Boot distributions to improve security. New source code includes updates to "lxmcurses", a new library "SD_stdio", and a recently developed port of "xtrs" TRS80 emulator to get away from X Windows toward curses terminal basis. A successful port was made to run in a terminal on PC, and using PuTTY with custom font as keyboard and screen, also an Arduino port to run on a PJRC teensy 3.5 microcontroller. GPERS includes TRS80 support including proprietary ROMs. Other distributions such as GLFPE may contain the source for the emulator, but NOT distribute the proprietary ROMs. A special nonpropietary ROM image which allows boot but does nothing else is included with the public version. Arduino sample source now includes all the necessary library support and 10 lessons for the Grove beginner Kit for Arduino, an Arduino Uno compatible project board with a number of interesting hardware devices prewired to run, such as an OLED module, temperature/pressure sensor, and 3-axis accelerometer. This kit is economical and suitable for learning how to program an Arduino microcontroller to interface with the outside world. Version 625 August 6, 2020 Primarily a minor update with no significant changes to applications, but updates to included sample source code to track a recent flurry of development both under /src and /Arduino. This version of source code has been specifically shrunk to reduce the sample open code footprint. The open samples are now limited to a relative few folders with shorter autobuild scripts to match. Arduino code has been selectively shrunk to remove redundant temporary personal code and leave in more significant working projects. This editing process is not yet complete, and will continue into future versions. Those library and app projects included will continue to be up to date as possible, but only a few projects in the GLF personal collection will be included in the base GLFPE distribution, as it is intended as a more general purpose OS for other users. GLF will concentrate new personal development and experiment with apps first in the GPERS personal proprietary NON-distribution, then roll working improvements into GLFPE. The personal OS includes a comprehensive suite of personal applications and source code, and at over 5 Gb does not fit on a DVD anymore. GLF will ensure the GLFPE distribution (intended to be GLF's primary public distribution) continues to fit on a DVD or FAT32 drive (under 4.2 Gb) to make it easier for others to try out. Version 624 July 20, 2020 First complete release (public) version since March 2020. Contains a long list of changes to contents, configurations, and procedures for maintaining configuration and building the ISO image. Some previously included packages have been removed for space, other new ones have been included. One key change has been the method by which large filesystem content is made available under the user's HOME folder. Using a methodology first developed for GPROG, the "Rosetta Code" demonstration distro, a number of intermediate versions of GPERS, GPROG, GFPCB, GWINE, and GLFPE included source code samples and proprietary emulator content under a custom /usr/share/work/user folder built into the live build OS image and given custom permissions and ownership to match the default live user "user". By putting large amounts of data into this custom location instead of the etc/skel location which is used to build the default user filespace on the fly at live boot, it is possible to avoid consumption of RAM and therefore RAMDISK space during a live session. In order to make the special folders available to the default user without effort, with expected permissions, symbolic links were created within the HOME folder (~). In the original scheme, these symlinks were precreated and stored within the configuration fileset and its .tar.gz archive. The scheme had one particularly troublesome drawback. The packing and unpacking of the symlinks into and out of .tar.gz format caused a problem which required special, nonobvious preparatory procedures to avoid, making the build process much more difficult to explain to a novice user. If the /usr/shar/work/user folder and/or its symlinked subfolders did not exist when a configuration archive was unpacked, the links would be broken. The normal method GLF, and presumably a normal user, would use to compress or decompress a file would employ the GUI archiver utility (Engrampa on Debian Mate). However, the broken links would cause the unpack operation to fail. Though it was possible using the command line tar utility to create a special script to unpack everything without stopping, it complicated matters for a novice user. The situation was avoided ONLY IF the folders actually existed within the visible filesystem during the session in which the configuration was unpacked. If they did not exist, a special process was needed to create the folders ahead of time. Such special handling was maybe OK for private distros such as GPERS, but not appropriate for the flagship public GLFPE. In addition, if the folders DID exist, and actually contained the planned content, then when the .tar.gz archive was created after a configuration was presumably edited to update it, the actual files seen under the symlinks would be redundantly stored into the archive, causing much larger .tar.gz files than necessary, and passing along more problems with the symlinks being treated as if they were real folders. For that reason, part of the special preparatory process wa to DELETE all content under the symlinked folders prior to editing and building a live build confguration. With version 623 and 624 of GPERS, GLF removed some such symlinked content (large AppImage files (for Openshot, Virtualbox extensions, and Krita) from the /usr/share/work/user folder and placed them directly under the /usr/share folder as normal applications, with custom launcher menu items (.desktop) files placed under /usr/share/applications. That led to another method for including all the other hidden source code and proprietary content (Arduino, src, TRS80, and C64) which also used symlinks in the HOME folder. GLF created a .desktop file and a script which when launched would create the HOME folder symlinks at run time. That method allowed all the advantages of having user-modifiable content vsible from the HOME folder, with necessary user permissions, without either consuming RAM nor requiring prebuilt symlinks which caused the need for special preparations during configuration. The change in method was propagated to GLFPE and GPROG, and now none of the distros require the prior special handling of custom folders or links. It also restores the ability to use any existing installed or live Debian 10 based OS session (compatible with CPU type) to build a GLFPE based distribution image, simplifying the procedure for novices and providing much more safety for a user building an OS image using an installed Debian OS as build host (it would be dangerous to backup and create the custom folders and delete content temporarily). THIS IS A BIG IMPROVEMENT. Beyond the restructuring of large filesystem content, several changes were made to the applications included within the distribution. GLFPE is a public distribution intended to be distributed widely, so proprietary content must not be included. A small subset of the GLF sample source code tree, with otherwise proprietary content stripped from the distribution, is included to allow a user to test the available C/C++ programming systems. A script is made available to batch-build all available C/C++ projects in the set in a few minutes. A subset of GLF Arduino projects and personal libraries is also included to allow a user to test microcontroller programming. Sample code from the GLF collection is also provided for a small set of FORTRAN, COBOL, Python, and in the 64-bit version only, node.js. Because GLF is experimenting with IDEs currently more popular (VSCode, Eclipse, Code::Blocks) than those adopted for everyday use by GLF (VIDE), these (large) packages were included into the 64-bit GLFPE distribution (they are not available for 32-bit Linux). The GLFPE configuration packs a lot in, but the ISO remains (just) small enough (about 4.4 Gb) to fit on a DVD or within a FAT32 partition, so it can be easily used to create either single or multi-boot drives. Recently a new method for multibooting linux ISOs became available and GLF made it available in the latest distributions (64-bit and 32-bit). Ventoy is a commandline utility which creates a specially formatted disk with two partitions, one a FAT32 boot partition, and the other an exFAT partition capable of holding files larger than 4Gb. The idea is to copy bootable ISO files directly to the exFAT partition (always named "ventoy"), and the boot process would provide a selection menu to boot directly from each ISO. It has its own issues and can be considered experimental for now. GLF created a special drive selection script to make it easier to launch Ventoy from a menu safely. Removed from version 624: Fritzing -- took up about 200 Mb including data, and was rarely used by GLF. It can always be installed later during a session. Spyder -- Python IDE which was found to be broken recently (would not start), probably caused by ongoing deprecation of Python 2 in favor of Python 3. Replaced with IDLE (below). Added to version 624 (or other recent versions): (64-bit AMD64 only) Krita -- excellent and popuylar graphics painting program Openshot -- as AppImage file rather than version in repository, which fails in practice. The AppImage has worked well, but is NOT the latest version available, which has problems crashing. Eclipse -- IDE for experimental adaptation of GLF C/C++ projects VSCode -- IDE for experimental adaptation of GLF C/C++ projects (Either 32-bit 686 or 64-bit) Ventoy -- new, experimental system to create multi-boot Linux USB drives. sysbench -- another version than previously included weas found in Debian Backports, which fixed an apparent bug. Now included a GLF script "benchmark" which uses sysbench in a consistent way to test CPU and RAM speed on multiple systems. IDLE -- IDE for Python development -- versions for both Python 2 and 3 GLFPE-examples -- menu item to make sample source code available via symlinks under $HOME. Version 616 through 623 -- PRIVATE, NOT DISTRIBUTED Experimental temporary builds not formally uploaded to website. Represent several lines of refactoring configuration elements and rethinking the underlying targets for public distribution. All real development took place within GPERS (NON) distribution, and development of GLFPE and other remix distris was suspended for several months. Also updated and upgraded several GLF C/C++ source libraries and applications. Also adapted source tree projects for use with Code::Blocks, Microsoft VSCode, and Eclipse IDEs. Version 615 February 15, 2020 After experimentation, GLF found that two included packages were not useful, and a replacement was found which worked well. Removed: joystick joy2key Added: qjoypad -- gui translation to keys, runs in background, config files under ~/.qjoypad3 GLF source folder -- updated to include a couple of new programs Add "make_new_project" script to /usr/local/bin to easily make new C/C++ projects from old Version 614 January 30, 2020 Both 64-bit and 32-bit versions of GLFPE have been restructured. GLF has implemented a major change of focus and structure for large data areas under home (~) folder. Based on work initially done for the new GPROG series (began with 614), data for Arduino source code, GLFPE sample source, and some other items have been placed under a new folder: /usr/share/work/user (and subfolders) which is designed to have the same ownership (user) and permissions (rwxr--r--) as the home folder. Symlinks placed in the home folder itself connect the user's attention to the data in that new directory. This scheme prevents the large data volume from diminishing the RAM disk available in Live Boot mode. Before, such data was placed into /etc/skel to populate the dynamically created user home folder at boot time. That data was copied to the RAM disk, and as such consumed it to the point there was little left. Putting under /usr forces that data into the .squashfs file which makes up the bulk of data making up the ISO image, and maximum RAM disk remains free in live mode. The new scheme requires a trickier compression and extraction process for the live build configuration set archive. The config data includes symlinks which may be temporarily broken if unpacked on a system lacking the resolving locations to which those links point. The Engrampa decompressor REMOVES such links during extraction, breaking the build config. Also, if those same locations contain actual data during the compression step, then that data will be double-stored in the archive, making the ISO redundantly larger than required and causing trouble later. The trick is to make sure the folders to which the symlinks point EXIST (under /usr/share/work/user) during extraction, but that during compression, those same folders are EMPTY of all data other than the folders themselves. A companion archive file structured with those folders empty of all content assists preparation for such operations. GLFPE has now dropped suport for emulators which require copies of copyrighted ROM data to run (Vice C64, xtrs TRS80, and mame -- every other game system). Because GLF is invested in these applications, they are included in GPERS (GLF personal) which is NOT publicly distributed. They are NOT included in either GLFPE or GPROG distributions (anymore). New applications added (64-bit only, not available as 32-bit): Oracle Virtualbox (by .deb file) Virtualbox licensed extension installer (via a symlink under home) Openshot 2.4.4 (AppImage newer than repository version which fixes crashing bugs) Applications removed: vice C64 emulator xtrs TRS80 emulator mame Gaming emulator collection ROMs) The above were removed to prevent distribution of copyrighted ROM data. See GPERS for a private, nont publicly distributed OS set which for GLF personal use which contains vice, xtrs, and mame, along with GLF personal virtual disk data. Openshot (repository version -- unusable due to bugs) handbrake Not used enough by GLF to keep it New data included virtually (via symlinks) under home folder: GLFPE sample source code collection (C/C++, FORTRAN, COBOL, and Python demo support). GLF personal collection of Arduino IDE compatible source code for microcontrollers. The above source code has been available separately for use with prior releases of GLFPE. Including it with the distribution makes it immediately useful for programming without repetetive copying when needed. GLFPE is now actually a subset of GPROG (omni language demo) and GPERS (GLF personal) configurations, and the sample code for C/C++ and Arduino is now included in all. Version 613 (skipped) Version 612 December 16, 2019 Added or modified GLFPE apps: checkinstall (incorporated as *.deb file from buster-backports) sysbench (version 1.0.19 locally compiled to *.deb) Database NOT INCLUDED in build, but suitable for CPU tests. Locally compiled version of sysbench package suitable for amd64 or 686 CPU. A 686 version was not available in "buster" repository, and available binaries from unstable or testing repository were not installable in buster due to library conflicts. Used "checkinstall" to create a usable *.deb file to install the locally compiled version by inclusion in "packages.chroot" folder. Version 611 December 11, 2019 Normal update -- no other changes Version 610 October 15, 2019 Normal update -- no other changes Version 609 September 4, 2019 Attempted to get autostart of desktop file (under ~/.config/autostart) to do a one-time password change. Mechanism proven to work for a simple bash script file (espeak "test', sleep 5) but attempt to get 'Change Password Once" to come up after login failed to diplay a terminal. The script MAY have been running (don't know) but the effect was to NOT present the user with a password change prompt. Scrap the attempt. Despite above, copy "change-password_once.sh" to "change_user_password.sh" and remove the one-time check. Change the desktop file (under "Applications/System Tools") to use the altered script instead, so the user may now change passwords multiple times. Add to package list: rename galculator Add to packages.chroot: sysbench This application is not in the normal Buster repository, but is in "sid" (unstable). Add the "sid" .deb file so benchmark is available. Version 608 Experimental -- Not used due to failed upgrade GLF thinks it desirable to prompt live boot user to change password, since the default password is well known. GLF has made several attepmts tp get some kind of automatic password change to show up during live boot, but has not yet succeeded. A script to perform the password change has been included in GLFPE for some time, with an entry in the menu, but this requires manual attention. Attempt to add boot time hook to change password -- failed to boot smoothly (hung up with Debian splash screen covering request for username. Attempt to actually enter username caused failure to boot ("user" not recognized). Abort use of this version, and continue use of version 607 until next update. Version 607 July 8, 2019 Upgrade Arduino IDE from 1.8.7 to 1.8.9. Version 606 July 8, 2019 Patch the "live build" configuration sets after examination of "lb config" manual and test results to include some missing configuration changes between Debian 9 and Debian 10. Specifically, a line item to specify UEFI Secure Boot was noticed and now included, though it appears to have not affected resulting images. Also, the website URLs for Debian repository and mirror specifications have been updated to remove references to older ftp sites (they will probably be deprecated in future). Update "multibootusb" package to latest stable version 9.2.0 and apply GLF patch to USB drive search order (reverse sort to show LAST mounted drive first). This update may patch a few bugs, especially in UEFI menu construction. It dooes NOT solve the problem observed by GLF which prevents 600 series images from booting the Legacy Mode menus on a multibootusb disk. Those images boot via "Grub" but the menus are default and truncated, and only limited boot time options are available. The 500 series (stretch) images still boot as expected with the (GLF-customized) legacy menus. NOTES on official release of Debian 10 and Secure Boot As promised, Debian released "Buster" on July 6, 2019. In association with that release they published the following live images which GLF downloaded for testing: debian-live-10.0.0-amd64-mate.iso debian-live-10.0.0-i386-mate.iso GLFPE Linux is based on a platform of Debian Mate, so these images represent a suitable starting point for bootstrap building an updated GLFPE ISO (as do any of the prior 600 series GLFPE ISOs). In case there were any last minute changess to the Secure Boot functionality before official release, GLF tested the two official Mate Live disks to verify bootability. As before, and as with prior tests of 600 series ISOs, the "amd64" target disk booted in any of Legacy, UEFI, or UEFI Secure Boot modes. However, as before, the i386 (686) target disk could boot Legacy, and (most of the time) UEFI, but the Secure Boot attempt always failed. Because of this, for now GLF will abandon further experimentation with 686 Secure Boot. This issue should affect very few users when natively booting the highest available CPU model on a given machine. That is, if one always boots the "amd64" version on a 64-bit capable machine, that machine often will have Secure Boot as an option, and that ISO should be completely usable in any desired mode. If one boots a "686" ISO on a 686-only machine, that machine is HIGHLY UNLIKELY to have Secure Boot as an option, so it should still boot without incident. The only reason to have a 686 image boot as Secure Boot is to test or use the disk on a more modern machine compatible with both 64-bit and 32-bit models, and that will only be problematic if the user insists on Secure Boot. If Debian addresses this in the future, it will probably just "turn on" in a future 600 series GLFPE build automatically, the way it did without any special configuration in amd64 builds of GLFPE so far. Version 605 July 4, 2019 This version is now essentially complete and consistent with other versions of GLFPE, especially Raspberry Pi. The Debian 10 based release is now stable for most users, and this version can replace GLFPE Linux 500 series based on Debian 9. Coordinate menu installation with Raspberry Pi equivalent GLFPE version "rpi10001", first extended and tested from Raspbian 10 on July 3, 2019. Many packages deprecated in Debian 9 and 10 (but still used in GLFPE) are still found in the Raspbian repositories, and do not need to be manually installed on Raspberry Pi from .deb packages (as still required for Debian 10). However, these manual installs are still needed for PC based Debian 10. Add "pinta" package back into distribution using packages.chroot/pinta_1.6-2_all.deb, acquired via Debian unstable (Sid) repository. This .deb file can be removed if the package ever goes back into the stable repository. Versions 604, 603, 602 Various incremental improvements to 602, 603, and 604 to improve compatibility with prior GLFPE versions and fix errors. Support for OpenCV 3.2 now included and tested with GLFPE sample source suite. The ISO images (for at least AMD64 versions) are now bootable under UEFI Secure Boot. Legacy boot menus still work as expected under single-OS installation to DVD or USB, but multibootusb installations for 600 series fail to boot from the main menu, and must go through the Grub Bootloader instead. This is inconvenient but still doable. Version 601 Initially converted from earlier work on Debian 9 (Stretch) based Version 527 (January 25, 2019). Identify and fix various system changes and package deprecations between Debian versions. Almost all prior applications and libraries transferred to new OS version, but the "pinta" package was omitted from the "buster" repository and substitute graphic editors "gpaint" and "mtpaint" are now included. These packages have small footprints and minimal functionality needed to edit (at least) the splash screen graphics for each GLFPE linux configuration set.