Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add pwsh support #537

Merged
merged 17 commits into from
Sep 15, 2024
Merged

Add pwsh support #537

merged 17 commits into from
Sep 15, 2024

Conversation

ACSimon33
Copy link
Contributor

Hi,
since there seemed to be no progress on the pwsh support ticket, I thought I'd just try it myself.

I've took the hints from the issue and addressed everything which is applicable to pwsh:

renderSettings procedure to:

  • define environment variable
  • unset environment variable
  • define shell alias (if this concept applies to PowerShell)
  • unset shell alias
  • define shell function (if this concept applies to PowerShell)
  • unset shell function

Aliases are defined as functions as well because pwsh doesn't support aliases that contain whitespaces or consist of multiple commands that take arguments.

  • execute xrdb command to define XResources
  • execute xrdb command to unset XResources

The two above are not applicable to pwsh as far as I can tell (at least on Windows)

  • execute PowerShell change directory command
  • renderAutoinit to output pwsh code to define the module function for the shell,

The autoinit works only on Unix platforms. On Windows, I defined the the environment and the envmodule command directly in the init script.

I've tested everything manually on Windows and Linux but I still need to get the testsuite running for pwsh. Also, I probably need to add something to the documentation. In the meantime, any feedback is appreciated.

Best,
Simon

Closes #326

@ACSimon33 ACSimon33 changed the title Added pwsh support Add pwsh support Sep 2, 2024
Copy link
Member

@xdelaruelle xdelaruelle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Many thanks for this contribution. That's great work.

In addition to the code review comment, main point is to add support in the installation testsuite (make testinstall). You will find it in testsuite/install.00-init/. This testsuite will check that pwsh correctly defines variable, function, etc with the commands generated by modulecmd.tcl

On the documentation side, things to add

Support for source-sh or sh-to-mod commands may also be added (translate a pwsh script into a modulefile). But it may be the topic of another pull request.

doc/source/index.rst Outdated Show resolved Hide resolved
init/Makefile Outdated Show resolved Hide resolved
.cirrus.yml Show resolved Hide resolved
tcl/envmngt.tcl.in Outdated Show resolved Hide resolved
tcl/envmngt.tcl.in Show resolved Hide resolved
tcl/envmngt.tcl.in Outdated Show resolved Hide resolved
@xdelaruelle xdelaruelle added this to the 5.5.0 milestone Sep 3, 2024
Copy link

codecov bot commented Sep 3, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 99.50%. Comparing base (672e287) to head (c17210a).
Report is 17 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #537   +/-   ##
=======================================
  Coverage   99.50%   99.50%           
=======================================
  Files          15       15           
  Lines        5453     5474   +21     
=======================================
+ Hits         5426     5447   +21     
  Misses         27       27           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

.cirrus.yml Outdated Show resolved Hide resolved
tcl/envmngt.tcl.in Show resolved Hide resolved
tcl/envmngt.tcl.in Outdated Show resolved Hide resolved
tcl/envmngt.tcl.in Outdated Show resolved Hide resolved
@ACSimon33
Copy link
Contributor Author

ACSimon33 commented Sep 4, 2024

@xdelaruelle I've added pwsh to the othlang_list in the installation tests because it often doesn't behave like a normal shell. Also, it was easier to write the install_test_pwsh handling the custom module command (envmodule). I fixed most of the things it was complaining about.
One issue is the support for MODULES_REDIRECT_OUTPUT. When we use exceptions as a way to signal an error, there is no way to redirect the message to stdout. And if we write the error message directly to stdout, we have no way of signaling that the command failed. We still can set the LastExitCode, but that is not really the current status code of the shell because it is normally only set by native applications and not pwsh functions/commands.
If we only want to redirect messages from like envmodule --version, that would work.

@ACSimon33
Copy link
Contributor Author

ACSimon33 commented Sep 6, 2024

@xdelaruelle I think I addressed everything now except the support for source-sh and sh-to-mod. I don't see this as an urgent feature because most environment scripts on Windows are still batch files. This can be dealt with in a follow-up PR.
The last thing that we might want to change is the INSTALL.bat script on Windows. The problem is that it puts the module installation directory into the system's PATH variable. This interferes with the module keyword in pwsh. I'd say we just remove that from the INSTALL script. CMD users can just source the init/cmd.cmd, which will set the PATH for them.

@xdelaruelle
Copy link
Member

Many thanks Simon for this deep work.

I will take over if I spot some finishing changes to do.

I will test everything on my side.

The pwsh initialization works similar to the cmd initialization.
Autoinit will not work on Windows due to the hard-coded paths in
modulecmd.tcl. On other platforms the autoinit should work for pwsh.
@xdelaruelle
Copy link
Member

@ACSimon33 module quarantine tests are failing so I suspect there is an issue with the code of this feature. Could you please look at it to fix it. If this is too hard or time-consuming for you, I may remove the feature for the moment (could be added later on).

Beware that I have reworked the commits of your branch, so you may pull these changes first, prior to push new commits.

@ACSimon33
Copy link
Contributor Author

@xdelaruelle […] The last thing that we might want to change is the INSTALL.bat script on Windows. The problem is that it puts the module installation directory into the system's PATH variable. This interferes with the module keyword in pwsh. I'd say we just remove that from the INSTALL script. CMD users can just source the init/cmd.cmd, which will set the PATH for them.

@xdelaruelle Is it ok if we remove the environment variable from the INSTALL.bat script? Alternatively we could create a new install script for pwsh which just copies the files and doesn’t set the env variable. That way nothing would change for CMD users.

- LastExitCode is now always set to 0 or 1, depending on the success of
  the command.
- If there is an error we throw an exception in envmodule and ml.
- If the subcommand is a query, e.g. `is-avail`, we return a boolean
  value.
Add support for the quarantine mechanism with pwsh shell.

Init script init/pwsh.ps1 does not handle quarantine on Windows platform.
There is no pwsh support there and if the installation test suite find
the windows pwsh.exe it will fail due to IO issues.
@xdelaruelle
Copy link
Member

@xdelaruelle […] The last thing that we might want to change is the INSTALL.bat script on Windows. The problem is that it puts the module installation directory into the system's PATH variable. This interferes with the module keyword in pwsh. I'd say we just remove that from the INSTALL script. CMD users can just source the init/cmd.cmd, which will set the PATH for them.

@xdelaruelle Is it ok if we remove the environment variable from the INSTALL.bat script? Alternatively we could create a new install script for pwsh which just copies the files and doesn’t set the env variable. That way nothing would change for CMD users.

@ACSimon33 I prefer no change for CMD users. Could you propose specific INSTALL/TESTINSTALL/UNINSTALL scripts for pwsh?

Subsidiary question: is there a way to automatically setup envmodule when pswh starts? Like done on *sh shells with profile script.

@ACSimon33
Copy link
Contributor Author

@ACSimon33 I prefer no change for CMD users. Could you propose specific INSTALL/TESTINSTALL/UNINSTALL scripts for pwsh?

Alright, I will create the corresponding pwsh scripts.

Subsidiary question: is there a way to automatically setup envmodule when pswh starts? Like done on *sh shells with profile script.

The path to the profile script for pwsh is stored in the $PROFILE variable. On Windows this is $env:HOME\Documents\PowerShell\Microsoft.PowerShell_profile.ps1 and on Unix it is at $env:HOME/.config/powershell/Microsoft.PowerShell_profile.ps1 (https://learn.microsoft.com/en-us/powershell/scripting/learn/shell/creating-profiles?view=powershell-7.4#how-to-create-your-personal-profile)

@xdelaruelle
Copy link
Member

Many thanks again @ACSimon33 for your deep work on this. Everything seems ready. I will merge the PR as soon as the CI completes.

@xdelaruelle xdelaruelle merged commit d1a2f87 into cea-hpc:main Sep 15, 2024
23 checks passed
@TaiXeflar
Copy link

TaiXeflar commented Sep 15, 2024

Hi,
I just wondering why not just using name modules to solve conflicted name module with pwsh?
the command it just looks like:

 modules av
 modules load ... ... ...
 modules purge

Thanks

@xdelaruelle
Copy link
Member

@TaiXeflar envmodule is already the name used on Ruby for the same kind of name conflict than for PowerShell. I also find it less confusing for people not knowing Modules and looking at script using its function: just an extra s may confuse them with the reserved keyword.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support for PowerShell/pwsh
3 participants