CVS log for loncom/lond

Up to [LON-CAPA] / loncom

Request diff between arbitrary revisions

Keyword substitution: kv
Default branch: MAIN

- For 2.11.4 (modified)
  Include change in 1.581

- For 2.11
  Backport 1.580, 1.581

- s-nail requires space instead of comma as separator between email addresses.

- For 2.11.4 (modified)
  Include changes in 1.580

- Current version should be 1 not 2 for resources published only once (i.e.,
  those without (numbered) previous versions in Resource Space.

- For 2.11.4 (modified)
  Typo in comments

- For 2.11.4 (modified)
  Include changes in 1.560

- For 2.11.4 (modified)
  Include changes in 1.577, 1.578, 1.579.

- Bug 6754 and 6907
  Correction to changes in rev. 1.578
  Add omitted arg ($type) to colon-separated items retrieved from $tail,
  and to args passed to Lond::sign_lti_payload().
- Update documentation and remove some trailing white space.

- Bugs 6754 and 6907
  - Return of grades to launcher CMS supported for resources or folders
    accessed via LTI-mediated deep link.
  - Support option: "Encrypt stored consumer secrets defined in domain"
  - Signing of LTI payloads for roster retrieval, passback of grades,
    and callback to logput launcher CMS session all now occur on
    primary library server for course's domain.

- Bug 6754
  - Can select from tool definitions set in course's domain or in course
    itself when using External > "External Tool" in Course Editor.
  - DC's configuration for allowed use of esternal tools within course types
    (can be overridden for specific course(s)) determines which External Tool
    types (if any) may be added to a course.
  - Signing of LTI payload used to launch an external tool now carried out
    on course's home server.

- For 2.11.4 (modified)
  Include part of one channge from 1.549 and 1.576 (modified)

- Typo

- For 2.11.4 (modified)
  Include changes in rev. 1.575 (part)

- For 2.11
  Backport 1.575 (part)

- Domain configuration to allow authentication of an alternate username, if
  username entered differs from real username in a predictable way,
  e.g., username entered in log-in page was email address (userid@example.tld)
  instead of just userid.

- For 2.11.4 (modified)
  Include changes in 1.574

- For 2.11
  Backport 1.574

- Sanity checking

- For 2.11.4 (modified)
  Include changes in 1.573

- Bug 6907
  - Support encryption of link protection secrets set in a course.
  - Requires perl-Crypt-CBC

- For 2.11.4 (modified)
  Include changes in 1.572

- Bug 6907
  - Extraction of LTI itemID based on consumer key in signed LTI payload, and
    verification with available secret moved from ltiauth.pm to Lond.pm.
  - Verification will now occur on course's home server or domain's primary
    library server, for course-defined LTI ID, and domain-defined LTI ID
    respectively.
  - Setting and modifying link protection key and secret now requires user
    session on course's home server.
  - Display of existing LTI key only available of course's home server.
  - Display of stored LTI secret eliminated so a Course Coordinator will
    need to record it offline or commit it to memory.

- For 2.11.4 (modified)
  Include changes in 1.536, 1.565 (part), 1.568

- For 2.11
  Backport 1.570, 1.571

- Support CentOS Stream 8 and 9.

- Support Rocky Linux 8 and AlmaLinux 8

- For 2.11
  Backport 1.569

- Use token to store role, symb, linkprot, and/or linkkey when dual log-in
  page to support SSO (Shibboleth) and non-SSO is in use, and for "log in
  again" retry link for failed login, instead of using query string directly.
- When digest is used by tmpput handler in lond to generate an id, only use
  id which does not already exist in LON-CAPA's tmp directory.

- New arg ($encrypt) for &get_dom, &put_dom, &dump, and &put calls in
  lonnet.pm, so request encrypted, and response (&get_dom and &dump)
  also encrypted, unless requests will go to current server.

- For 2.11.3 (modified)
  Include changes in rev. 1.566, 1.567

- For 2.11
  Backport 1.566 (part), 1.567 (part)

- Support customization in localenroll.pm to eliminate ambiguity in extraction
  of institutional section from institutional course section for automated
  enrollment.

- Support institutional policies which allow a Course Coordinator affiliated
  with a cross-listed course to be automatically listed as a co-owner in a
  course.

- For 2.11.3 (modified)
  Include changes in 1.565

- For 2.11
  Backport 1.565 (part)

- Bug 6585
  get_domain_handler() and encrypted_get_domain_handler() in lond now use
  get_dom() routine in Lond.pm

- For 2.11.3 (modified)
  Include changes in 1.564

- For 2.11
  Backport 1.564

- If $env{'request.balancercookie'} set for user's session, and switch made
  to a different node, update hostID in cookie on balancer node once migrated.

- For 2.11.3 (modified)
  Include changes in 1.561, 1.562, 1.563

- For 2.11
  Backport 1.563

- Fix logic.

- For 2.11
  Backport 1.562

- Last activity data for course users from server's in course's domain on
  "What's New" page.

- For 2.11
  Backport 1.561

- For 2.11.2 (modified).
  Use 2.12 feature (LTI) pre-release, in modified 2.11.2. Domain's
  configuration must be set to prohibit hosting of sessions for
  domain's users outside own domain, and modification must be in
  place on all nodes in domain.

- Last activity data for course users from server's in course's domain on
  "What's New" page.

- For 2.11.3 (modified)
  Include changes in 1.536

- For 2.11
  Backport 1.536 (another part).

- For 2.11
  Backport 1.536 (part)

- For 2.11
  Backport 1.558

- For 2.11
  Backport 1.551

- For 2.11
  Backport 1.550, 1.559

- Bug 6754. LON-CAPA as LTI Provider.
  Domain configuration to support session expiration in LON-CAPA,
  after user logs out of LTI Consumer which originally launched session,
  (if Consumer supports logoutServiceUrl; e.g. custom_logout_url in Canvas).

- Support Oracle Linux 7

- Domain Configuration for Passwords for internally authenticated users.
  - Rules for LON-CAPA passwords can include: number of user's previous
    passwords to save (with reuser by that user disallowed).

- Fix name of perlvar.

- Domain Trust Settings for multi-domain library server.

- Support Certificate Revocation List checking.
  - Change order of args in lonssl::Read_Connect_Config() as third arg used
    by call from lond (for Server) but not from LondConnection (Client)

- Remove trailing whitespace.

- Trust settings

- Domain Trust Settings

- Domain config for load balancer to use cookie to record offload target.
  Subsequent requests by same user/browser will send requests to same target
  if remote session still active, and remote node not overloaded.

- Replace use of mailto (metamail package) with mail command.
  metamail was in Red Hat 7.3, but is absent from Fedora, CentOS, RHEL etc.

- For 2.11
  Backport 1.541

- Cluster manager can push updated Certificate Revocation List to cluster's
  "name servers".

- LON-CAPA SSL certificate verification
  - Detect revoked or expired certs, or certs with incorrect Common Name.
  - If host cert or hostname cert are not OK, check if a valid CSR exists,
    and if so, report status of that.
  - perl-Crypt-PKCS10 needs to be added to LONCAPA-prerequisites.

- Don't display folders for "in-course" authored resources in lonindexer,
  when dirlist called on pre-2.12 instance.

- Compatibility with pre-2.12 LON-CAPA versions of loncnew.

- Support Certificate Revocation List checking when using SSL channel
  for key exchange during negotiation of connection to remote lond.

- Include verification of common name when creating SSL tunnel. Fall back
  to insecure connection (if allowed) if verification fails.

- For 2.11.2 (modified)
  Include changes in 1.489.2.29

- For 2.11
  Backport 1.542

- Bug 6754 LON-CAPA as LTI Provider
  - Creation of new LON-CAPA user account available from an LTI Consumer.
  - Creation of new LON-CAPA course available from an LTI Consumer.
  - Self-enrollment in a LON-CAPA course available from an LTI Consumer.

- Checking if enrollment data can be accessed for a course uses a single
  call to localenroll::check_instclasses(), mediated via lonnet/lond.

- If replication fails when retrieving an resource which has been updated,
  unsubscribe and remove the existing file, as it's no longer current.

- For 2.11.2 (modified).
  Use 2.12 feature (LTI) pre-release, in modified 2.11.2. Domain's
  configuration must be set to prohibit hosting of sessions for
  domain's users outside own domain, and modification must be in
  place on all nodes in domain.

- For 2.11
  - Backport 1.538, 1.539, 1.540

- Remove blank line.

- Sanity checking in ls, ls2 and ls3 handlers.
  - Status can be returned by ls, ls2, and ls3 for a file in:
      /home/httpd/html/userfiles/<domain>/<username>/
  - If client is thee homeserver, status also returned by ls3 for a file in:
     /home/httpd/html/priv/<domain>/<username>/

- Sanity checking changes in rev. 1.529 for ls3, ls2, and ls were too
  restrictive, as lonnet::dirlist() which leverages ls3 etc. is called by
  lonnet::stat_file() to retrieve status an individual file in /res/.

- Eliminate use of alarm(), now that LWP's own timeout is used.
- Update information about prerequisites.

- Key and Secret for LTI Tools are stored in a separate GDBM file
  (encconfig.db) on primary library server in domain so more specific domain
  trust settings can apply than is the case for regular domain configuration
  (in configuration.db).
- Storage and retrieval of data from GDBM files for domain, with namespaces
  beginning 'enc' use encryption when data are transferred.

- Domain Trust Settings

- For 2.11
  - Backport 1.534

- If LON-CAPA Directory searches are disabled for other domains, enforce
  that on the lond side, in case user session is hosted on a 2.11.1 (or earlier)
- Expire 60 minutes caches of 'usersessions' and 'directorysrch' settings
  (used by lond) on domain's servers when domain configuration changes.

- For 2.11
  - Backport 1.533

- Domain configuration for internally authenticated users.
  - (a) Option to switch from crypt to bcrypt automatically when user is authenticated.
  - (b) Option to set bcrypt cost.
  - (c) Option to compare bcrypt cost for user with current domain config
        when user is authenticated.
  Defaults are: (a) No, (b) 10; (c) No

- Use of LON-CAPA SSL certificates to create secure channel for exchange of
  encryption key between LON-CAPA nodes can be set to: "no", "yes", "req"
  (i.e., required) separately for outbound (i.e., lonc) and inbound connections
  (i.e., lond) in domain config (default domain only on a multi-domain server).
- Can differentiate between connections between nodes in same domain, nodes
  in same "internet" domain. and nodes in neither.
- Supercedes use of loncAllowInsecure and londAllowInsecure from loncapa.conf
  on each node.
- Run /home/httpd/perl/loncron --justreload (as www) after changing domain config

- Include lonAdmEMail and lonSupportEMail in data from conf files which is
  accessible via lond::read_lonnet_global().

- For 2.11
  - Backport 1.530

- Modify regexp in ls3, ls2, and ls handlers so list of published authors
  in a directory is displayed.

- For 2.11
  - Backport 1.526

- For 2.11
  - Backport 1.529

- Sanity checking for ls3, ls2, and ls handlers.

- Domain Trust Settings

- Domain Trust Settings

- Sanity checking.

- Domain Trust Settings

- For 2.11
  - Backport 1.522

- For 2.11
  - Backport 1.518, 1.524

- Bug 5679

- For 2.11
  - Backport 1.521

- For 2.11
  - Backport 1.520

- Use Server Name Indication (SNI) and SSL when replicating content from
  /raw/.
- Domain status screen has link to show status of LON-CAPA SSL certificates.
- "SSL" domain config for (a) "internal" LON-CAPA SSL connection to servers/VMs
  in other domain, (b) Replication of domain's resources to other domains.
- Replication can use name-based virtual hosts with SSL, with verification of
  client certificate (cert: /home/httpd/lonCerts/lonhostnamecert.pem, signed
  by LON-CAPA CA, with Common Name of internal-<server hostname>, same IP address
  as server hostname).

- Bug 6808. New course container -- "Placement" for Placement Tests.
  - Student's score on a placement test can be exported by customizing
    localenroll.pm in /home/httpd/lib/perl on domain's library server.
  - When a placement test is completed by the student, the chain:
    lonnet::auto_export_grades() > lond::auto_export_grades_handler()
    > localenroll::export_grades() is used to export grades (e.g. to
    a CMS).

- Sanity checking

- &remove_user_file_handler() should remove .bak file (if one exists)
  when removing uploaded html file from a course.

- Bug 6808. New course container -- "Placement" for Placement Tests.
  Work in progress.

- Bug 5679

- Score upload form supports identification of a user based on clicker ID,
  for Course Coordinators who prefer not to use LON-CAPA's in-built
  "Process Clicker" utility.
- clickers.db file on a library server contains key = value pairs, where key
  is (escaped) clicker ID, and value is (escaped) comma-separated list of
  usernames who registered that particular clicker ID.
- bi-nightly run of searchcat.pl will update clickers.db file.

- For 2.11
  Backport 1.515.

- Remove logging line added in rev. 1.494.

- Additional keys supported in hashref populated in localenroll::crsreq_updates()
  to customize "textbook" course request page:
   - createdactions (set course settings, post-creaton, e.g., self-enrollment).
   - createdcustomized (suppress standard display of "Make another request etc.)
   - onload (actions to execute on page load).
   - validationjs (items to include in the form validation function).
   - javascript (additional javascript functions for use with textbook
        course request form).

- For 2.11
  Backport 1.512, 1.513, 1.514

- Support SLES12.

- &newput_user_profile_entry() needs to untie hash in case where hash had
  been tied but put failed because new key already exists.

- Bug 6740 Out-of-order recording of submissions (by time).
  - Check for new transactions made immediately before call to lonnet::cstore()
    &Apache::inputtags::hidealldata() called if correct then incorrect,
    where awarded >= 1 when correct (feedback on correctness enabled).
  - Check for transactions made immediately after call to lonnet::cstore()
    if reply from lond::store_handler() is delay:N (where N s the number of
    transactions between the last retrieved in &initialize_storage() and the
    last stored immediately before permanent storage of the current transaction.
    &Apache::grades::makehidden() called if correct then incorrect,
    where awarded >= 1 when correct (feedback on correctness enabled).

- For 2.11
  - Backport 1.511

- krb5_init_ets is undefined symbol in Krb5.so on RHEL7, CentOS7 etc.

- For 2.11
  - Backport 1.510

- Backport 1.510.

- For push of dns_hosts.tab or dns_domain.tab from a manager server in the
  cluster to a "dns" server in the cluster, confirm complete transfer of data
  by comparing received data ("push" from manager) with data retrieved from
  "pull" of /adm/dns/hosts or /adm/dns/domain.

- For 2.11
  - Backport 1.509

- Pass default start access date and default end access dates to
  localenroll::crsreq_updates() so they are available to course request
  validator.

- For 2.11
  - Backport 1.508

- Course requests for unofficial courses, textbook courses and communities
  can include validation.
  - lonrequestcourse.pm
    - New subroutine: pending_validation_form() generates web form used to
      proceed to validation (can be local script, or script on remote server)
    - Prepended new arg to args passed to: &print_request_outcome() and
      &process_request()  -- $lonhost (lonHostID of current server).
 - localenroll.pm
   - &validate_crsreq() accepts additional (optional) arg -- ref to hash of
     custominfo.
   - &crsreq_updates() supports additional action type ('prevalidate') which
     is used to generate form elements needed for validation of request.
 - lond
   - &validate_crsreq_handler() accepts additional -- $customdata
     which is a frozen hash of custominfo passed in from lonnet.pm
 - lonnet.pm
   - &auto_courserequest_validation() accepts additional arg -- ref to hash of
     custominfo (contains key => value for custm form elements retrieved from
     course request review page.

- For 2.11
  - Backport 1.507.

- textbook is additional type of course which may be requested.

- For 2.11
  - Backport 1.505, 1.506

- New routine in localenroll.pm -- &crsreq_updates() -- to support
  domain-specific operations during course request process.
- Tabbed interface used for textbook-type course requests, one tab
  for course creation, one for request logs.
- Column for unique codes included in user's request log display, if
  domain has enabled use of unique codes.
- Correction to LON-CAPA messaging of unique code -- recipient should
  be requestor.

- Access to information about courses in a domain with six character
  unique codes (html, xml or csv format).
  - Initial use case is for a separate portal (token-based auth)
    where students enter the code to sign up for a specific "textbook"
    course.

- For 2.11
  - Backport 1.504.

- Support SuSE 13.1

- For 2.11
  - Backport 1.503

- Change to args expected by lonnet::remote_devalidate_cache() and
  change to corresponding &server_devalidatecache_handler() on lond side.
  - On the lonnet side remote_devalidate_cache() now expects an array of
    escaped cache keys as the second argument.
  - On the lond side &server_devalidatecache_handler() calls
    lonnet::devalidate_cache_new() on each of the cache keys passed to it.

- For 2.11
  - Backport 1.502.

- Web interface to support switching users to filesystem authenticated was
  removed in LON-CAPA 2.6.0 (same for new filesystem auth users, except via CLI).
  - Eliminate the LON-CAPA internals which supported the old web interface.

- Missing # in backport in rev 1.489.2.6.

- For 2.11
  - Backport 1.501

- New routines to delete unwanted keys from ids.db GBDM file in a domain
  lond: &del_id_handler() called to process "iddel" request from lonc side
  -- &iddel() routine in lonnet.pm.
- searchcat.pl will compare id => username retrieved from ids.db with
  expected id => username retrieved from each user's environment.db file
  (loops over user directories in /home/httpd/lonUsers/$dom), and updates
  ids.db based on latest data in environment.db, and logs actions.

- For 2.11
  - Backport 1.500

Consistent wording: "file name" vs. "filename"
Use "filename" since this is more commonly used.

- For 2.11
  - Backport 1.490, 1.492, 1.493, 1.494 (part), 1.499

- Support SuSE 12.3.

- For 2.11
  - backport 1.498.

- Course credits for a particular institutional code can be provided as a
  third item returned by localenroll::validate_instcode()
- Course credits can be specified for an official course (or retrieved from
  localenroll::validate_instcode) or an unofficial course as part of a course
  request
- Credits earned for a course can also be different for a specific student
  (e.g., retrieved from institutional classlist data), or specified when
  CC adds a student to a course via the web GUI.

- For 2.11.
  - Backport 1.495, 1.496, 1.497.

- init_ets() in Authen::Krb5 deprecated, and not supported in krb5-1.10
  (used by SuSE 12.2).

- Typo in perl doc.

- Update internal.contentchange in course's environment.db whenever a change
  is made to folders in Main course documents on a pre-2.11 server.
  (On 2.11 and later, update not required on lond side, as session hoster
   performs the update via lonnet.pm).

Saving my work (preliminary).
changes related to BZ 6585
   - moved dump_course_id_handler into Lond.pm
   - moved dump_profile_database into Lond.pm

- Backport 1.491.

changes related to BZ 6585
lond:
- moved get_courseinfo_hash into Lond.pm

changes related to BZ 6585
lond:
- $clientversion is now also set for clients < 2.9.
  Subroutines can rely on $clientversion instead of checking for empty string
  followed by a look up in %loncaparevs.
- moved functional body of dump_with_regexp into Lond.pm
- moved check_homecourses, releasereqd_check and useable_role into Lond.pm

Lond.pm:
- incorporated changes that have been made to lond 1.491 (removal of $extra
  parameter)
- clean up

- lond uses client's LON-CAPA version to determine whether checking a user's
  course roles for version requirements needs to occur -- will be skipped
  on 2.10 and later, as it occurs client-side in rolesinit when building
  roles/courses display.
- No longer require sixth arg for lonnet::dump
    (frozen hash containing skipcheck => 1).
  - Reverse changes in loncommon.pm 1.982, longroup.pm rev 1.26, 1.27
    loncreateuser.pm rev 1.350, lonuserutils.pm 1.127, 1.137,
    lonnet.pm rev 1.1086, 1.1078 which used the "$extra" sixth arg.

*work in progress* BZ #6585
Outsource functional aspects of lond into a separate module Lond.pm.
Functionality in Lond.pm will be used in lond and lonnet.  lond will continue
to handle data transfer across the network while lonnet will handle requests
(e.g. dump) in cases where the request originates from the library server that
hosts the data. Thus avoiding serialization and IPC through several sockets
(lonnet <unix socket> lonc <inet socket> lond <- file.db becomes
lonnet <- file.db).
This greatly improves performance on library servers that are also used as
access servers.

See Bugzilla 6585 for details.

- Change in args passed to &check_homecourses().
  Eliminate user's domain ($udom) as arg.
  - %homecourses is now hash of hash of array, where outer hash key is domain
    of course role, and inner hash key is coursenum of course role.
 (Addresses corner case: LON-CAPA version checking in lond for roles retrieval
  for a user for whom home server is a multi-domain server, and where user
  session is hosted on 2.9 or older, and where course domain is different to
  user domain, but current server is home server for both user and course).

- Add documentation for code in &dump_with_regexp() and for routines
  used by it, that suppress display of course roles requiring LON-CAPA 2.10
  or newer, for user sessions hosted on servers running 2.9 or earlier.

BZ6580 - in is_author - untie the user hash as well as tying it.

- Backport 1.486.

- Use hostname in place of IP address to avoid a "certificate verify failed"
  issue with certain SSL configurations.

- Backport 1.485.

- In &dump_course_id_handler(), make filtering of courses by owner work
  when course owner is the only filter.

- use lonDocRoot perlvar in place of static string: '/home/httpd/html'.

Bug #1320: NOT SURE IF THIS IS NEEDED ANYMORE
If we don't support UNIX accounts anymore,
we should remove calls to lcuseradd from lond

Bug #1320

- Backport 1.476

- Fix subroutine name used for devalidation of cached items via lond.
- Fix arguments in call to &reply() for devalidation of cached items
  on remote server.
- Domain configuration for loadbalancing is at top-level of
  configuration.db, and not at a level lower (in usersessions).

- Specify types of globals available from &read_lonnet_global() in lond.
  - Include lonBalancer from httpd.conf
- lonnet::get_remote_globals() returns two arguments - $result (ok etc.),
   and reference to hash of lonnet globals retrievable from remote server.

- New routine in lonnet.pm - remote_devalidate_cache() to devalidate memcache
  for specific key on remote server.
- Corresponding new routine: &server_devalidatecache_handler() on lond side.
- &remote_devalidate_cache() called when spares configuration changed for
  hostIDs for a particular domain via Domain Configuration screen.

- Correction  to scalar and looping in &read_lonnet_global() added in 1.477.

- New routine in lonnet.pm: &get_remote_globals()
  to retrieve contents of package globals for lonnet.pm on a remote server.
  - Corresponding handler in lond: &read_lonnet_global().

- Backport 1.476.

- Replace hardcoded 'http' with check for protocol used by remote server.

- Backport 1.475.

- architecture check.

- Backport 1.471, 1.472, 1.473, 1.474.

- Duplicated &try_to_lock() routine moved to one location (in LONCAPA.pm).
- Try to get locks for lock_apachereload and lock_lciptables before
  making system calls (in lond and loncron respectively).

- Replace &loncapa_dns_server() in lond with &is_LC_dns() in lonnet.pm
- Sender address not relevant for e-mail sent when dns_*.tab updated
- lonHostID and IP for client which called PushFile in lond.log and e-mail.

- Routine to check if server is a LON-CAPA "DNS" server.
- Only log warning about missing managers.tab if server is a DNS server.
- Limit files which can be modified via PushFile to:
  hosts.tab, domain.tab, dns_hosts.tab and dns_domain.tab
- Send e-mail to Admin when a remote manager has called "pushfile" to
  update dns_hosts.tab or dns_domain.tab.

- Routine to report distro/architecture of a LON-CAPA server.

- Backport 1.468, 1.469.

- Backport 1.470.

- Pass optional coowners arg to &localenroll::new_course().

Replace deprecated Reuse flag with ReuseAddr flag in listen call.

Block sigpipe in children here as well to allow clean closes.

Log spam

- Backport 1.462.

- In light of bug 6377, enforce timeout of 3s for each call to get courseinfo
  (nohist_courseids.db entry) for a course with a different home server.
- Such calls occur when courseinfo for course is not cached, and user's own roles
  are being retrieved (home server is 2.10) but user session is on a
  pre-2.10 server, and course's home server is on a different library server.

- Specify package for is_cached_new().

- Skip caching, if already cached.

Remove debug setting.

Close data socket in parent after forking child to service it.

Take out spurious dirty log call.

?? in initnewstatus add ()'s for time call ??? was getting undefined
reference messsagtes for $now() in the next line in FC13.

- Only cache courseinfo for courses with this server as homeserver if
  visited in last 24 hours or if in current user's list of active or future roles.

- Missing brace in 1.457.

- Efficiency.
  - Skip release check for expired roles before calling &releasereqd_check,
    instead of within releasereqd_check subroutine.

- lond
   - skip server side checking of roles looks for item named skipcheck
     instead of clientcheckrole.
- lonnet.pm
   - Additional arg in &dump() is hashref to allow flexibility for future
     changes in key => value passed to dump_with_regexp in lond.
   - skipcheck for dump of roles for other cases besides &rolesinit.

Remarks on timeouts in replication

- Change the way tokens are named.

- Checking LON-CAPA version requirements on lond side (for clients running pre-2.10).
  - Move version checking from &dump_with_regex() to separate routine: &releasereqd_check()
  - Fix pattern matching for roles in courses to accommodate roles with sections.
  - For courses on same server as user, tie nohist_courseiddump.db directly.
  - For courses with home server elsewhere use lonnet.
  - Do not check version requirements for expired roles.

- lonnet::get_internet_names() returns a reference to an array.

- Allow letters in Version name after major and minor version number
  (e.g., 2.10.0.RC1).

- For Course/Community roles requiring a specific minimum LON-CAPA version,
  where server hosting session is not running a recent enough version:
  (a) If server hosting session is running 2.10 or later, switch server
      link shown for role on roles/courses screen.
      - switch is to a server in user's domain (if any have required version)
        or to a server in course's domain (if any have required version).
  (b) For servers hosting sessions running 2.9 or earlier, lond on the
      user's home machine will only supply information for roles which
      can be run on the version on the server hosting the session.

- $clientversion is not provided by remote clients running pre-2.9 versions.
- For those clients use value from local %Apache::lonnet::loncaparevs hash,
  which is populated from /home/httpd/lonTabs/loncaparevs.tab
  (rebuilt by nightly loncron).

- Control hosting of user sessions.
  - To accommodate multi-domain library servers, use internet domain names (e.g., msu.edu)
    instead of LON-CAPA domains in interface DC uses to set options for session hosting.

  - Provide mechanism to retrieve lonHostID for a hostname, so we can tell which
    domain determines session hosting config for external users on a multi-domain
    machine.

  - New routines in lonnet.pm:
     &get_server_homeID()  -- gets lonHostID for a hostname
     &internet_dom() -- gets internet domain name for a LON-CAPA Host ID
     &get_internet_names() -- gets internet domain names for all domains
                              for a server given one of the LC host IDs for the server.

   - New file in /home/httpd/lonTabs:
     - serverhomeIDs.tab (populated by loncron). : paired hostname:lonHostID

   - New subroutine in loncron: &write_serverhomeIDs() -- populates serverhomeIDs.tab
   - New subroutine in lond: &server_homeID_handler() -- returns LON-CAPA Host ID of server
   - New scalar in lond: $clienthomedom -- set to domain of LON-CAPA Host ID of client
   - New subroutine in domainprefs.pm: &build_location_hashes()
       -- used to set up options for session hosting as internet domain names
           - where two names (e.g., msu.edu, loncapa.org) are controlled by the same
             institution these will receive a single checkbox.

- Following the switch to 2.10, domains may prefer that their users do not have sessions hosted on older versions of LON-CAPA.
- Domain Coordinators can control:
  (a) where their users may have sessions hosted (by domain and/or LON-CAPA version).
  (b) which other domains will have user sessions hosted on servers in the domain.

- Correction to regexp used in detection of Community roles in dump of roles.db.
- Correction to regexp used to extract version information from Version string.
- Community roles available on homeserver of Community, regardless of version.

- DC can override course-specific cloning rights:
  (a) when DC creates a single course in a domain:
    (All courses in that domain are cloneable for all course owners).
  (b) when DC creates a single community in a domain:
    (All communities in that domain are cloneable for all community owners).

- For legacy courses, where course owner was stored as username instead of
  username:domain, need to append (not prepend) course domain.
  (for comparison with username:domain of user for whom cloning is needed).

The &logthis()-line created tons of log spam on multidomain machines.

Typo

- Fix pod and eliminate pod2html warnings.

- roles.db files are different as the keys within are not escaped.

- Bug 6170.
  - Kerberos 4 libraries are notincluded with revision 1.7 of krb5 package.    Hence, perl-Authen-Krb4 is unavailable for distros using 1.7 (or later)
    - Currently: Fedora 12 or later, and openSuSE 11.2 or later.
  - authentication checking for krb4 or krb5 auth types moved to
    separate routines. krb5 check used for users with krb4 auth type,
    if Authen::Krb4 unavailable.

- Retrieve last access time for courses from nohist_courseids.db
  - lonnet.pm: New routines: &courselastaccess() and &extract_lastaccess()
  - lond: New routine: &course_lastaccess_handler()

- Bug 6176. Owners of courses can clone them even if they no longer have an
  active Course Coordinator role.

- Coding style.
  - Uniform style for location of braces in subroutines in LON-CAPA.

- Customization for GCI_3
  - Equivalent to fix for bug #6139 for .tmp files.
  - Remove local tn-preview files on re-publication.
   (preview files have .tn extension when generated for GCI Test Assembly).

- Community Roles available in 2.9.

Bug #6139: remove tmp-preview of replicated resources. UNTESTED. Need to
test on library-access-server setup!

- Accommodate Communities
  - Custom role template depends on course type.
  - System-wide bre priv unavailable in custom roles used in Communities.
  - System-wide bro priv (own authored/co-authored published resources)
     available for custom roles in Communities.
  - Community Roles (including custom roles) will not be displayed in LON-CAPA
    versions 2.9 or older.

- Distinctive courseID for Communities - all begin with 0
- LONCAPA::match_community will match this type of courseID
- Client session sends installed LON-CAPA version when initiating lonc/lond
  connection to remote server.
- Roles in Communities unavailable for user sessions hosted on LON-CAPA
  releases which predate 2.9.

- Pick course search needs to return courses which have a stored creation
  date/creator, even though there is no filter for this.

- "Unspecified" activity time from pickcourse search form is 1 not 0.

- Courses which have never had activity should not show up in course searches
   filtered by course activity today, last week etc.

- Backport 1.428.

- Feedback to point to user's homeserver if reset fails.

- Store creation date, creator, and creation context in nohist_courseids.db file.
- Include additional filters to filter courses by creation date and creation context when retrieving information from nohist_courseids.db.

- &Apache::lonnet::auto_validate_instcode() now returns an array containing:
  - the outcome ('valid' - or some other message) and
  - an (optional) brief description for the course retrieved from
     localenroll::validate_instcode() which likewise returns an array of 2 items.
- Used to set cdescr form element in the course request form for official courses when the instcode has been validated.

- Reverse changes in lond 1.420.
- &newput_dom(), &dump_dom and &del_dom in lonnet.pm now use the corresponding routines for user files - &newput, &del and &dump - with domain db data stored in .db files belonging to the domainconfig user.
- new routine: &get_domainconfiguser() provides the username of the domainconfig user.

- lond
  - update documentation in lond for validate_instcode_handler().
  - &crsreq_checks_handler()
     - include ref to reqtypes array
        - official, unofficial, community
     as arg in call to &localenroll::crsreq_checks_handler().

- enrollment::localenroll.pm
  - update &validate_instcode() to accept three args, and modify documentation.
  - add &crsreq_checks() to determine which types/affiliations should have 'validate'
    choice for processing course requests.
  - add validate_crsreq() to determine next action for a course request for which
    process type is 'validate'.

- msu::localenroll.pm
  - Add &crsreq_checks() and &validate_crsreq().
  - Update &validate_instcode()
    - owner is $username:$domain
    - outcome for valid course is 'valid' instead of 'ok'.
    - correct text of a couple of $outcome messages were course was not validated.

- &crsreq_checks_handler() added to interface to localenroll::crsreq_checks() to determine if "validate" should be an option which can be set for course requests on the DC's configuration menu.
- &validate_crsreq_handler() added to interface to localenroll::validate_crsreq() to determine if course request (with process type 'validate') should be processed immediately, put in a 'pending' queue, rejected, or marked for approval by a DC.

- lonnet::auto_validate_instcode() used to check if requestor's status permits automatic processing of the course request.
- Additional arguments now passed (besides $instcode and $owner) include comma-separated list of requestor's institutional affiliations (e.g., Faculty, Staff etc.) and comma-separated list of sections.

lond:validate_instcode_handler()
- Passes additional arguments on to corresponding routine in localenroll.pm.

localenroll.pm - update stub args and documentation for validate_instcode().

- Filtering domain roles search by start and/or end time now actually works.
- In lond
  - $end, $start reversed.
  -efficiency
      - Check for specific role now occurs first.
      - Move on to check next user as soon as current user fails to satisfy a filter.

Similar functionality to that provided by newput, dump and del for user .db files provided by newputdom, dumpdom and deldom for .db files at the domain level.

New routines:  &dump_dom(), &newput_dom() and &del_dom() in lonnet.pm
send calls via lonc/lond which are handled on the lond side by:
&newput_domain_handler(), &dump_dom_with_regexp() and &delete_domain_entry()

- Additional args for &lonnet::courseiddump().
  - Can filter courses to only retrieve courses cloneable by requestor/owner of new course.
  - Will retrieve information about allowed cloners (including courses for which cloning rights apply automatically because of active CC role).

- Term used for collaborative space changed from Group to Community.
- Coordinator role for Community simply called "Coordinator".

lonpickcourse.pm
- Wording change.  "Course Type" changed to "Type".
- course filter form now sets a form element named "command" to 'gosearch' on submit.
- course filter form will automatically reload, but not search,
  if either Domain or Type are changed.

courseclassifier.pm
 Javascript function "setOfficial() checks if caller arg is defined

lond
&dump_course_id_handler() change.
 - change to the effect regexp_ok arg.
 - now if arg has a value of -1, a course will be excluded from the resturned list,
   if the instcode matches the RE.
   This excludes "official" courses (i.e., those with an instcode matching the expected pattern for the domain) from the list returned in a search for "unofficial" courses.

- &localenroll:possible_instcodes() takes an addition arg: $code_order which indicates the order in which components of the course code should be recombined.
  - e.g., At MSU, select boxes in the course request form are in the order:
          Year Semester Department
    but the order used to create the institutional code is:
          Semester Year Department

- &lonnet::auto_get_sections()
  - $cnum arg is undefined when checking for institutional sections during the course request process.  In the is case the homeserver used to retrieve the sections is the primary library server for the domain.

- &lonnet::auto_validate_instcode() - new routine used to validate an institutional course code during course requests.
  - Note: this differs from the institutional courseID (which in the institutional code with appended institutional section).

- Request course creation
  - &auto_possible_instcodes() added to lonnet.pm to retrieve acceptable values for institutional categories (e.g., Year, Semester, Department).
  - corresponding &get_possible_instcodes_handler() added to lond
    - requires customization of a &possible_instcodes() routine lin localenroll.pm

- Backport 1.415

dump_domainroles_handler:
 start and end need to defined for roles to be filtered out  based on start date and/or end date.

Turn off debug flags so it won't spew into the logfiles.

- lonnet.pm/lond infrastructure to support enquiries about LON-CAPA version running on a server.
Work in progress.

Debugged lond/lcinstallfile support for cluster administration of
dns_hosts.tab and dns_domain.tab  see also clusteradmin in this directory..

Support updating pretty much any table file from a remote manager (in
a compatible way with prior management requests).

- When course activity log data are stored in $cnum_$cdom_activity tables, timestamps are stored using lonmysql::sqltime() which employs the server localtime.
- Student Activity displayed with trackstudent needs to have these timestamps converted to the time zone set for the course.
   - &server_timezone_handler() in lond retrieves server time zone from /etc/sysconfig/clock or /etc/timezone depending on distro.
   - &get_server_timezone() in lonnet.pm gets server time zone from course's homeserver.
   - &gettimezone() in lonlocal.pm can now take a timezone as an argument.
       - will validate it, and return it if valid, 'local' otherwise
   - &convert_timezone() in lontrackstudent.pm converts timestamps prior to display, and includes course time zone.

Documented log messages that can be emitted as POD entries.

Bug 5783.
- Don't prepend $perlvar{'lonDocRoot'} to $ulsdir when using lond::ls3() to list files in a directory in CSTR.

- If $catfilter provided, split on &, to support case where "Include subcategories within category" checkbox was checked.

- A course can be categorized into multiple categories. When searching for
  courses based on category, course will match if the category filter is
  one of the categories assigned to teh course.

- Check for a specific value (yes) of "hidefromcat" entry in nohist_courseids.db to exclude from matched courses.

- Update documentation in lond for &dump_course_id_handler().
   - Add the ability to filter on course category, and to exclude a course from
     results returned for course catalog display.
- lonnet::courseiddump() accepts two additional arguments
  - $showhidden (DC only, if 1, exclusions based on $caller (below) will not apply).

Backport 1.402, 1.403 (bug 5720).

- pop last element from @courseitems array outside loop.

Bug 5720.
Corner case where record for a course in nohist_courseids.db was still using old : separated format for value in $key=$value pair (i.e., not yet changed to frozen hash), only use lasttime from final item in value text string ian case where there is no lasttime:$key item yet ($key is escape courseID).

- user selected category (from course catalog) can be used as a filter in the display of courses.

ls3_handler modifications
- replace check for alternate_root defined, with check it is not ''.
- $dir_root is prepended to $ulsdir if it is not '' and add a '/' between if needed.

- &ls3() is a replacement for &ls2.
   - Where the path needs to be constructed for user's directory when performing a directory listing, this now occurs on the homeserver side, instead of being generated in lonnet.pm on the session server side.

- &du2() is a replacement for &du
   - Where the path needs to be constructed for user's directory when checking disk usage, this now occurs on the homeserver side, instead of being generated in lonnet.pm on the session server side.

- Both needed for future username virtualization (changes made homeserver-side).

- &ls2() and &du() retained for backwards compatibility when session server is running a legacy lonnet.pm

If filtering for self-enrollment, include in course matches if self-enrollment is active, or will become active in the future.

- Replace "selfenroll" with "selfcreate" in various subroutine names, and modify text which refers to self-enrollment to refer to user creation of accounts.
- Intended to clarify that these procedures relate to a user creating his/her own account in a LON-CAPA domain as opposed to self-enrolling in a course, once the user has an account.

lond::validate_user() - optional fourth and fifth arguments added in lond 1.395, replaced with a single optional argument ($checkdefauth). If true, default auth type and args retrieved using lonnet::get_domain_defaults().
- Default authentication type and argument, and language in a domain can be retrieved from lonnet::get_domain_defaults().
- lonnet::inst_rulecheck() can check format rules for e-mail addresses proposed as usernames for self-enrollment
- lonnet::inst_userrules() can retrieve rule definitions for e-mail addresses used as usernames
- loncommon::get_auth_defaults() eliminated. lonnet::get_domain_defaults() used instead
- loncommon::preferred_languages() streamlined.
- localenroll::selfenroll_rules() and localenroll::selfenroll_check() added to define rules for e-mail addresses which may not be used as usernames, and to check a proposed self-enrollment username (i.e., e-mail address) against the rules in force.

If a domain is using institutional authentication (i.e., kerberos or localauth), and a user does not currently have a LON-CAPA account, try to authenticate using default authtype and autharg, if these were passed as arguments.

- Starting with version 1.7, a perl module for Authen::Krb5 has begun to be included in standard repositories for Fedora 7 and 8 (previously rpms have come from the LON-CAPA repositories).
- The get_in_tkt_with_password() function seg faults in Authen::Krb rev 1.7 (the corresponding interface is deprecated in the Kerberos C libraries, but the Perl module docs indicate that it should continue to work.
- The function get_init_creds_password() is now used, where it exists, as it does not seg fault in 1.7.

Bug 5561. Double linefeed caused request/response process via lonc/lond to get out of sync.

&validate_class_access_handler() - pass the comma-separated owner list to localenroll::check_section() instead of splitting into an array. (For backward compatibility with existing localenroll::check_section() implementations.

- update the documentation for the check_section() stub in enrollment/localenroll.pm to indicate that $owner can be comma-separated list owner and co-owners.

lond
- storage of course information by &courseidput(), i.e., data coming from pre 2.6.X servers - unescape the values received since the freeze_escape() used to store them does the escaping.

lonnet.pm
- when flushing logs, do not escape items in buffers because &courseidput() either uses freeze_escape() for 2.6.X home servers, or does the escaping when building the string to send to pre-2.6.X home servers.

- $storehash is a hash of a hash - need the top level key.

Changes in lond rev 1.387 resulted in some cases of double linefeeds, causing out-of sync behavior for some requests.

&get_institutional_id_rules() and &institutional_id_check() available to retrieve information about ID rules from localenroll.pm, and to check a proposed ID against ID rules for the domain, for which checking is enabled.
- also when applying roles filter in &dump_domainroles_handler() use \Q\E to protect each role extracted from nohist_domainroles.db

bug 5474.

- preventing lond from ballooning in size on large dumps/restores other commands

   - passing very long strings apparently causes perl to make internal
     allocations of temps that when finished with while freed, aren't
     released back to the OS, this should pass the very long strings
     by reference now

- removing accidental commit

- remove duplicate use

Bug 5191.  Decouple storage of last access time for a course in nohist_courseids.db from storage of course information.
- Retain backwards compatibility with legacy lonnet::courseiddump()

Other general change: uniform use of 'inst_code' as key in frozen hash instead of 'instcode'.

lond
&put_course_id_handler()
- last access stored in escaped lasttime:courseid key = value hash item
  if legacy lonnet::courseiddump() updates courseinfo.
&put_course_id_hash_handler()
- additional argument - $mode ('timeonly', 'notime' or 'all')
  - determines whether last access, or courseinfo (description,inst_code,owner,type) or both are stored
&dump_course_id_handler()
- documentation updated
- style (replacing unless)
- change location of unescaping when checking filters so double escaping no longer needed for courseinfo stored in frozen hash
- return courseinfo in hash form, if requested as hash, when record has yet to be converted to a frozen hash
&validate_class_access_handler()
- eliminate extra unescaping of $ownerlist

lonnet.pm
&flushcourselogs() includes 'timeonly' argument in call to courseidput().
&courseidput() - if in 'timeonly' mode only courseids are sent to lond in courseidputhash call.
&createcourse()
- courseinfo values in hash no longer escaped (freeze_hash handles this)
- call to flushcourselogs() replaced by call to courseidput()

lonmodifycourse.pm
- courseinfo values in hash no longer escaped
- call to courseidput() includes 'notime' as fourth arg.

coursecatalog.pm
- remove unneeded code, since entry for each course in %courses hash will now be a hash ref.

courseclassifier.pm
- remove unneeded code, since entry for each course in %courses hash will now be a hash ref.

lonpickcourse.pm
- Entry for each course in %courses hash should be a hash ref, when constructing for onlyown courses case.
- instcode to inst_code
- no need to unescape courseinfo value (thaw_hash in lonnet::courseiddump does it)

lonparmset.pm
- call to flushcourselogs() replaced by call to courseidput() after updating course description.
- appenv user's session with new course description.

Store data in nohist_courseids.db as a hash.  Maintain backwards compatibility with writes to the db from legacy lonnet.pm, and also reads from the db from legacy lonnet.pm.

Start towards inclusion of co-owners as well as a single owner, for the purposes of verifying access to official classlist data.

lond
- &put_course_id_hash_handler() added to handle storage of data in nohist_courseids.db as a frozen hash.
- &put_course_id_handler() will add to an existing hash if update is from a legacy lonnet which supplies : separated data.
- &dump_course_id_handler() $as_hash flag extracted from tail. If set, data are returned as a hash.
- validate_class_access_handler() will extract comma-separated owner and co-owners from ownerlist passed to it, and send array ref to localenroll::check_section() to determine if at least one on the owners is authorized to view classlist list data for the institutional section.

lonnet.pm
- storage of hash via call to courseidputhash in lond.  If command is unrecognized on the lond side, subset of the data sent as : separated values
- retrieval of data from nohist_courseids.db - additional $as_hash argument included in courseiddump call to indicate that data should be returned as a frozen hash.
- auto_validate_class_sec() - if third argument is an array ref, then an owner list is built from the supplied owners and co-owners.
- lasttime set on lonnet side (FIXME) - to be changed to lond side.

lomodifycourse.pm
- updated course settings sent as a ref to a hash to lonnet::courseidput()
- include LC_error in span for error messages
- eliminate duplicate error message
- display error if storage of changes fails
- form name corrected to cmod.

coursecatalog.pm
- eliminate unused arg from call to courseclassifier::retrieve_instcodes
- display owner and co-owners (sort by lastname)
- institutional section access for multiple owners

courseclassifier.pm
- course codes from course data if hash, or if : separated string.

lonpickcourse.pm
- course info extracted from hash
- owner info displayed in a list if owner and co-owners exist.

- backport 1.382

- when offloading a user session to a different server, check the remote
  servers for an existing session and pick one of those first
  - new lond command that checks if a session file exists for a specific user
  - new lonnet routines to probe servers for one

Namespacing of usernames.
lonnet.pm
 - &get_instuser() can check the institutional directory for a username or an ID.
                   -returns hash of user information (lastname,firstname etc.)
 - &inst_rulecheck() can check whether a username matches the formats of institutional username rules.
 - &inst_userrules() can retrieve information about username rules defined for the domain.
&get_instuser uses lonsql as a conduit to localenroll::get_userinfo() - operating in mode 1.
&inst_rulecheck() and &inst_userrules() use lond directly as the conduit to localenroll::username_check() and localenroll::username_rules() respectively

lond
 - &get_institutional_user_rules() is interface to localenroll::username_rules()
 - &institutional_username_check() is interface to localenroll::username_check()

lonsql
 - &get_inst_user() retrieves is interface to localenroll::get_userinfo()

- toss error messages if krb5 fails

- correct comments

- moving inst dir queries into lonsql

- typo

- Add subroutine: inst_dirsrch_handler() to access localenroll::get_userinfo() used for searches of institutional directory information.
- Incoming $tail argument (2nd argument) includes : separated domain, srchby, srchterm and srchtype (middle two escaped).
- srchby can be: uname,lastname or lastfirst (username, lastname or lastname,firstname) respectively.
- srchtype can be exact or contains.
- srchterm is string being searched for.

- when doing reconnects, be more targeted, just reset the retries on the
  one loncnew child (if it even exists)

- stop killing of the connections to myself during reload process

- eliminate a unneeded global

- eliminate reading of now defunct manager table

- can explicitly flush the cached host info
- logic on which children to kill was backwards

- prevent bombing on machines with old localenrolls

- callling wrong routine

- eliminate host.tab reading in lond and use lonnet now

- stop causing a flog of reconlonc when a new client connects

- one more lonnet replacement needed

- use lonnet, eliminate copies of ruotines taht are in lonnet

- eliminate any reading of hosts.tab from loncnew
- launch of lonc connection requires passing the lonid through the common
  launch socket
- dealyed messages getting sent again (requires loncnew using lonnet....)

- switch lond to use new multiplex lonc communication route
- swithc to making the common socket a config option

- bug#5185, don't count directoies against quota

Routines to retrieve institutional status types (e.g., faculty, staff, student, affiliate) from localenroll.pm on a domain's primary library server.

Use get_domain_handler().

In cases where FC6 is run with Authen::Krb5 1.5 or earlier, prevent the call to init_ets(). (This is deprecated in Krb5.pm rev 1.6, so distro detection will not be required for future distros).

$credentials->initialize() was causing a segmentation fault for krb5 on 64 bit machines, when passing a previously defined object. Not sure why, but creating the object in situ eliminates the segfault.

- typo

- allow for and log negative values from localauth

Prevent stripping of trailing null fields in split() by setting limit to -1.

Undesired stripping of trailing null fields had caused extra : separators to be written in values in nohist_courseids.db between type entry and final entry (last access), in some cases where there was no course owner.  Set numcurrent to a maximum to eliminate the extra items the next time put_course_id_handler() runs to update the entry for a particular courseID.

Include type in courseidput when modify_course() results in change in course owner or institutional code.

Typo (sectionums should be sectionnums).

- lonid can have . and - now

- fixing tabination

- add in domain to localauthing

- clean after causing it to be correct

	Deine $namespace before using it.

- switch to using the cleaning routines for controlling what is valid in a db name

- fedora5 also doesn't have the ets code

Put and get data in specified db files at the domain level of the primary domain server (e.g., domain configuration settings in configuration.db).

This is the same location as used currently for ids.db, nohist_courseids.db, and nohist_domainroles.db and nohist_dcmail.db.

Modify tmpput handler in lond to use md5_hash of random items when creating token for password resets to provide less deterministic token.

Add an extra argument to lonnet::tmpput() so context is included when request sent to lond (if context argument was supplied).  It appears some uses of lond::tmpput make use of the number_IP_number structure of current token.

Add Forgot Password link to log-in page.

Some wording changes in reset password page.

More comprehensive check of e-mail for valid format.

Require user to provide e-mail address when requesting password change, and compare with e-mail in record associated with LON-CAPA user account.

Allow internally authenticated users who have forgotten their password access to set a new one based on a token sent to an e-mail account associated with their LON-CAPA account. Future mods: strengthen challenge by asking for student ID? Use less deterministic token ID from lond::tmpput() - MD5 hash?

Get regular expression fragments and order of concatenation when creating regular expressions used in course catalog search by institutional code (or parts thereof) - used by coursecatalog.pm

Allow institutional code filter to be a regular expression (default is no regexp), when getting data from nohist_courseids.db via courseiddump.

- support new db style env hash

- some courseid history have oddly long entires, so looking for blank rather than definition

- check_section might not exist protect lond from dying

Validation of institutional class identifier (coursecode + section OR crosslisting) - does course owner have rights to access classlist information in the specified class?  Also correction to documentation for &create_auto_enroll_password_handler() in lond.

- more bad syntax (BUG#4975)

- ip nolonger in hosts.tab

- fixing some broken splits

Bug 4813.  Retain backwards compatibility with legacy courses in which only a course owner's username is stored in environment.internal.courseowner, and in the course's record in nohist_courseids.db.  New courses will include username:domain (escaped) in nohist_courseids.db.  MCRS can be used to update legacy course owner information (just click "Modify Settings" button, it will be necessary to select the correct course owner where the course domain is different from the owner's domain.

- $group will always be defined, but in the no group case it's blank

- BUG#4562, when unsubbing from a resource (because there is a new version
   and we don't need it) the old meta file didn't get deleted thus poising
   things with old data until the file got repulled over.

Course type used in nohist_courseids.db to differentiate courses and ANGEL-style groups.  Can also be used as a filter when selecting using lonpickcourse.pm

- forward port 1.302.2.7

- need to lock the env file to successfully read from it
   (student photos failed to show up because of conflicts over desire to
    write new tokesn to the env and desire to read if the token existed)

Separate out the locking tie/untie-hash functions, so they can be used by
service programs.

- backport 1.330

- session env is now stored escaped

Again, saving my work on zipping.

Do a shared lock before even testing for the existence of a .gz file

- style police

Saving my work: new locking and zipping/unzipping mechanism

Script to archive .db and .hist that have not been accessed in 120 days
lond automatically unzips them if needed

- removing some code duplication

Course groups have chat with access restricted to group members hwo have group chat privilege for the group.

- backport 1.319

- adding put store to expiremental branch, with support for compressed stores

- move putstore logic to lond's side of things
    - changes currently don't handle newer client talking to older lond

- annotate the compressed versions  as such

- have lond handle the inline sethost: cmd
- set the lond version in lonc which can handle this

- need to check for definition of $hashref

- backport 1.320

- eval the new photo routines so lond/sql don't die in the middle of them

- get rid of the copy/paste code

- fix currentdump

- add timestamp to the entry

- an expiremental change to lond to reduce space consumed by store/restore hashes

Prepare to do filtering of lonsql results based on the domain that lond is
running under

- backport 1.317 1.318

- style police

Add support for student photo import from an institutional repository. Availability of photos of registered students in a course controlled by course environment parameter: 'internal.studentphoto'.  This may be configured to require initial acceptance of conditions of use by course owner.  View classlist in ENRL, and Automated Enrollment Manager now includes option to display thumbnails of student photos.  Nightly enrollment update can import student photos for students added to a course.  Student photos can be updated via the Automated Enrollment Manager.

- backport 1.309,310,311,312,313,314,315,316

- convert to throwing numerical errors

- typos

- removing deugging logging

- BUG#4608 & BUG#4476, lond now should block for up to 13 seconds waiting for  lock on a db file

- making tie_*_hash and untie_*_hash use common routines to do their work

- centralizing the usage of untie

- remove last direct usages of tie

- making restore: user the tie_user_hash croutine

- backport 1.308