CVS log for loncom/loncron

Up to [LON-CAPA] / loncom

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN
Current tag: MAIN

- Fix typo and remove trailing white space.

- Report if file could not be opened for writing.

- Use three-argument open() to separate file mode from the filename.
- Report if a file could not be opened for writing.

- %simplestatus is a global.
- Check file handle for writing to loncron_simple.txt is defined.
- Coding style: eliminate use of $_ in log_simplestatus().

- Remove empty line.

- Nightly run of loncron checks if bash readline library's default value for
  enable-bracketed-paste for user www needs to be overridden, and if so, for
  R and maxima, by setting to off in /home/www/.inputrc for those applications.

- Typo

- Nightly run of loncron checks if bash readline library;s default value for
  enable-bracketed-paste needs to be overridden using /home/www/.inputrc.

- s-nail requires space instead of comma as separator between email addresses.

- Reverse changes in 1.127, as they duplicated changes in rev. 1.104.

- Prevent 'undefined subroutine' errors when loncron is run on a domain's
  primary library server.

- Need to take into account the number of CPUs when determining whether load
  average needs to add to the count of notices, warnings or errors.

- Remove trailing white space.  No code changes.

- Correct name for directory where balanceIDs are kept.

- Get hostname from Sys::Hostname::FQDN::fqdn.

- symlink removed when session file to which it links is stale.

- Format of header line for logged changes in IP address of hosts in network
  is: | Hostname | Previous IP | New IP |

- Format for logging change in IP address of a LON-CAPA host in network is:
  | <hostname> | <previous IP> | <new IP> |

- Bug 6754. LON-CAPA as LTI Provider.
  Domain configuration to support session expiration in LON-CAPA,
  after user logs out of LTI Consumer which originally launched session,
  (if Consumer supports logoutServiceUrl; e.g. custom_logout_url in Canvas).

- loncron --justiptables will update dynamic iptables rules for lond port,
  and nothing else (e.g., run this after restarting iptables).

- loncron will check for changes in IP addresses of LON-CAPA hosts in network.
  Domain configuration for recipient of e-mail if changes occur. Also logged
  permanently in /home/httpd/perl/logs/hostip.log

- Use LWP to retrieve domain configuration from domain's primary library server.

- Domain config for load balancer to use cookie to record offload target.
  Subsequent requests by same user/browser will send requests to same target
  if remote session still active, and remote node not overloaded.

- Scanning of lonnet.perm.log by loncron
  - Information about which nodes have unsent update transactions is logged.
  - Specific nodes can be excluded from unsend count (for delayed updates)
    via domain configuration.
  - Weight for unsend count (before adding to "warnings") is configurable.

- Nightly loncron: threshold for sending mail, and weighting for notices,
  warnings and errors in "totalcount" are configurable in node's default domain.
- Whether to copy status mail to core dev. group (and threshold) configurable.

- Replace use of mailto (metamail package) with mail command.
  metamail was in Red Hat 7.3, but is absent from Fedora, CentOS, RHEL etc.

- Replace use of mailto (metamail package) with mail command.
  metamail was in Red Hat 7.3, but is absent from Fedora, CentOS, RHEL etc.

- Skip tailing daemon logs when calling context does not update lon-status.

- Dereference hashref.

- Fix syntax errors in rev. 1.107

- Support Certificate Revocation List checking when using SSL channel
  for key exchange during negotiation of connection to remote lond.

- Add nightly update of Certificate Revocation List (from CA) to loncron.

- Warnings count excludes items in lonnet.perm.log for nodes which are no
  longer part of the cluster.

- Use of LON-CAPA SSL certificates to create secure channel for exchange of
  encryption key between LON-CAPA nodes can be set to: "no", "yes", "req"
  (i.e., required) separately for outbound (i.e., lonc) and inbound connections
  (i.e., lond) in domain config (default domain only on a multi-domain server).
- Can differentiate between connections between nodes in same domain, nodes
  in same "internet" domain. and nodes in neither.
- Supercedes use of loncAllowInsecure and londAllowInsecure from loncapa.conf
  on each node.
- Run /home/httpd/perl/loncron --justreload (as www) after changing domain config

- Eliminate "caching of id  ... failed" messages in lonnet.log when starting
  or restarting loncontrol.
  - Do not attempt to use memcache to store dns:/adm/dns/hosts, dns:/adm/dns/domain
    and iphost:iphost, when memcached is not running in this particular situation.

- WebDAV session housekeeping.

- Changes to satisfy w3c xhtml validation.
- Eliminate use of metasend (provided by metamail) as currently supported
  distros tyically do not have this installed.
- Include headers (Content-type, MIME-Version etc.) in e-mail of status page
  contents so e-mailclients will display content as HTML.

Consistent case and punctuation of output text

lonnet.pm
  - Move code in BEGIN() block in lonnet.pm used to populate %loncaparevs and
    %serverhomeIDs to subroutines: load_loncaparevs() and load_serverhomeIDs()
    to facilitate reuse.
loncron
  - In loncron delay opening loncaparevs.tab and serverhomeIDs.tab files for
    writing until retrieval of version or server information is complete for
    all contactable servers.
   - Call load_loncaparevs() and load_serverhomeIDs() once writing is complete.

- Move routine used to get Linux distro from &get_distro() in loncron
  to &distro() in LONCAPA.pm to facilitate reuse.

- Fix typo in rev 1.96.
- %perlvar is a global; no need to pass by ref to &write_checksums()

- Utilities to checksum LON-CAPA modules to verify integrity of
  LON-CAPA installation, and also to check the availibility of new
  LON-CAPA releases.

- Do not modfy $warnings count in check_delayed_msg() if $unsend total is
  negative.
- Don't attempt pong to server in /home/httpd/sockets/delayed if
  server is not listed in cluster tables.
- Log pong timeout and also if server in delayed is not in cluster.

- lchttpdlogs needs to run to tail Apache logs.

- Bug 6475.  lchttpdlogs is script called by loncron to tail web server logs.
  - Eliminate "cannot open <logfile> for reading: Permission denied errors
    with /etc/init.d/loncontrol (re)start.
  - tail of Apache logs now written to /home/httpd/html/lon-status/index.html
    by nightly run of loncron.

- Fix indents in 1.91.

- 20s timeout when attempting to contact each server with an entry in
  /home/httpd/sockets/delayed.

- Include timeouts within &write_loncaparevs() and &write_serverhomeIDs()
  so script is not tied up by unresponsive hosts.

- Duplicated &try_to_lock() routine moved to one location (in LONCAPA.pm).
- Try to get locks for lock_apachereload and lock_lciptables before
  making system calls (in lond and loncron respectively).

- unlink the file not the filehandle.

- Skip population of loncaparevs.tab and serverhomeIDs.tab when starting loncontrol
  to reduce delay.

- Allow letters in Version name after major and minor version number
  (e.g., 2.10.0.RC1).

- Control hosting of user sessions.
  - To accommodate multi-domain library servers, use internet domain names (e.g., msu.edu)
    instead of LON-CAPA domains in interface DC uses to set options for session hosting.

  - Provide mechanism to retrieve lonHostID for a hostname, so we can tell which
    domain determines session hosting config for external users on a multi-domain
    machine.

  - New routines in lonnet.pm:
     &get_server_homeID()  -- gets lonHostID for a hostname
     &internet_dom() -- gets internet domain name for a LON-CAPA Host ID
     &get_internet_names() -- gets internet domain names for all domains
                              for a server given one of the LC host IDs for the server.

   - New file in /home/httpd/lonTabs:
     - serverhomeIDs.tab (populated by loncron). : paired hostname:lonHostID

   - New subroutine in loncron: &write_serverhomeIDs() -- populates serverhomeIDs.tab
   - New subroutine in lond: &server_homeID_handler() -- returns LON-CAPA Host ID of server
   - New scalar in lond: $clienthomedom -- set to domain of LON-CAPA Host ID of client
   - New subroutine in domainprefs.pm: &build_location_hashes()
       -- used to set up options for session hosting as internet domain names
           - where two names (e.g., msu.edu, loncapa.org) are controlled by the same
             institution these will receive a single checkbox.

- Following the switch to 2.10, domains may prefer that their users do not have sessions hosted on older versions of LON-CAPA.
- Domain Coordinators can control:
  (a) where their users may have sessions hosted (by domain and/or LON-CAPA version).
  (b) which other domains will have user sessions hosted on servers in the domain.

- Rotate autoupdate.log and refreshcourseids_db.log.

- Bug 6125.
  - clean_tmp() is recursive in sub-directories within /home/httpd/perl/tmp.
  - unlinks stale files within sub-directories, and also removes empty
    sub-directories - exception: helprequests and subdirectories within
    addcourse (as low as "pending" and "processed" in hierarchy) are retained.

loncron updates firewall access to lond port (5663) when connections are updated.
- uses lciptables (setuid script which calls routines in LONCAPA::Firewall.pm).
- list of IPs of hosts in cluster stored in temporary file, so
  lciptables does not need to load lonnet.pm
  (contains inadmissable commands in setuid context).

Check up on lonr.

Unfortunately, my loncontrol (not yet committed) fails to properly start
lonr.

Bug 5903. perlvar is a hash, not a hashref here.

Bug 5903.
Receipt address(es) for loncron status e-mails configurable via Domain Configuration.

Eliminate lonhttpd on port 8080 due to increasing number of user and
institutional firewall issues

- lond needs lonmenmecached so start it first

- some maxima's want to figure out what dir we are in, and blowup on
  intialization if it's not in a directory in can read, so chdir to the
  daemons directory before we start doing stuff

- cleanup sockets directory when starting or stopping lonc

- bug#5199 rotate more log files

- updated to use lonnet.pm for host information and reply communication

- eliminated old lonc

Adding lonmaxima daemon.

Ponging tested and working - and now even has a linebreak.

Pong machines with delayed messages.

Could not test yet on laptop.

- revert to USR1 to lonc

- Pretty sure lonc only ever needs a USR2 now

- typo

- modifying loncron to have a reply function like lonnets

- by default no longer test the connections every night
- by default do cause lonc/d/apache to do a reload everynight

- check that the value in the pid file is a number beforeing trying to kill it

- add the dist to the status page

- making it sleep for less time

- 'reload' command now sends USR2 against lonc/d causng them to reread the hosts.tab/doain.tab files

- specify a larger than default size for metamail

- adding memcached as a daemon we need to start up

- IP removal from hosts.tab

- stop ponging start pinging

Increase threshold for network admin emails - with more machines in the
cluster, lots more connection warnings, etc.

- no hyphen should be passed to ps

- Fedora doesn't have  metamail, so if metasend fails, fall back to just mailing the file off

- rotate the _error files too. (Possibly BUG#3036)

- get rid of old 'new' hack for starting using loncnew and use real cmdline arg

- add command line args to loncron

- xhtml clean

- add GPL header

- modularized (refactored?)

- BUG# 2565

- making it easier to run loncnew,
   /etc/init.d/loncontrol startnew
   /etc/init.d/loncontrol restartnew
  will now start loncnew in place of lonc

- retabinate

- made the restart of daemons look more obvisou as to what is going on
- updated status messages to be less obtuse

Simple one-line status for cluster-wide automated reporting

Cut down number of messages, so admins still pay attention.

- always start lonsql

- allow for larger log files, as things have gotten more noisy

Raise bar on emailing systemwide administrator

best wishes to all.

- Fixes BUG#989
- lonhttpd can't handle a USR1

The little server that could (on port 8080).

fixing invocation of read_conf (loncapa_apache.conf does not need to be
directly specified)

Toward bug 481.

To use token-based access, use for example

'<img src="'.&Apache::lonnet::tokenwrapper($fulluri).'" />'

- handles blanks lines in hosts.tab
- sorts it's output

- I'd like it to run more quickly (at least for the conference)

Cleans up CHECKOUTTOKENS only after 100 times normal expiration. Bug #240.

- should not declare globals as my if to be global
(This will make it so the "connections" sections doesn't always say con_lost)

access.conf -> loncapa_apache.conf

using LONCAPA::Configuration::read_conf
BUG 129

Sends USR1 to lond

Able to start loncron through web server

Kills more radically - especially, kills orphans who would become zombies
(and block the IO Socket while alive).

adding intelligent handling of stale lonsql.pid file

do not e-mail when running in quick mode

adding an option to make this script run quickly without sleeping
(based on Guy suggestion)

making sure that lonReceipt and lonSqlAccess are not displayed
for lon-status/index.html -Scott

enabling lonsql on library servers -Scott

changing the line
        system(
 "$perlvar{'lonDaemons'}/lond
2>>$perlvar{'lonDaemons'}/logs/lonc_errors");
to
 	  system(
 "$perlvar{'lonDaemons'}/lonc 2>>$perlvar{'lonDaemons'}/logs/lonc_errors");
 in two places -Scott

outputting errors and warnings to logs/lond_errors, logs/lonc_errors,
and logs/lonsql_errors..  suppose this might be done with
handling SIG{'__WARN__'}, but am not if __WARN__ is called
only via the "warn" function or is always output whenever
data is sent to /dev/error (or the device corresponding to #2) -Scott

fixing error message sent to standard output when faulty configuration
happens -Scott

adding a part to make sure LON-CAPA is configured before launching
processes. -Scott

fixing up the enforcement of running this process as user=www.
should be absolutely positively complete now. -Scott

added 7 lines of code to "Make sure this process is running from user=www"
-Scott

Cleans out tmp and lonIDs

replace kill 2 with a powerful killall -9 to completely wipe the system
clean of the parent and children processes -Scott

the parent being a zombie process is an impossibility (according to Guy). -Scott

fixed handling to have else clause when dealing with erroneous .pid
files -Scott

added "intelligent" handling of non-responding processes as
they relate to .pid files

disabling lonsql for now so that newly installed library machines do not crash

added in invocation of lonsql

loncron less judgemental

Put in additional sleep so that children do not die before reaper in place
(lonc)
Marked up logs
Put in report for after the lonc/lond start into loncron

Senddelayed moved from lonnet and loncron to lonc - not tested

Initial revision