{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "In order to successfully complete this assignment you must do the required reading, watch the provided videos and complete all instructions. The embedded survey form must be entirely filled out and submitted on or before **_11:59pm on January 23rd_**. Students must come to class the next day prepared to discuss the material covered in this assignment. " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "---" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# PCA 5: Navigating Shared Clusters (HPC)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Goals for today's pre-class assignment \n", "\n", "1. [Create XSEDE Account](#Create-XSEDE-Account)\n", "2. [Finding software on the HPCC](#Finding-software-on-the-HPCC)\n", "3. [Assignment wrap up](#Assignment-wrap-up)\n", "\n" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "\n", "\n", "---\n", "\n", "# 1. Create XSEDE Account\n", "\n", "\n", "\n", "\"Picture\n", "\n", "The National Science Foundation invests quite a bit of money into providing computing resources to researchers. The Extreme Science and Engineering Discovery Environment (XSEDE) is a single virtual system that scientists can use to interactively share computing resources and expertise. Here is a short video that describes XSEDE." ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "from IPython.display import YouTubeVideo\n", "YouTubeVideo(\"PBUIBJHZzD4\",width=640,height=360)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "This XSEDE resource has not been replaced by ACCESS. The old resource is the first link below. You can learn more about the new ACCESS resource in the second link below. \n", "\n", "https://portal.xsede.org/#/guest\n", "\n", "https://access-ci.org " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "\n", "\n", "---\n", "\n", "# 2. Finding software on the HPCC\n", "\n", "\n", "The following video describes the ```PATH``` environment variable and shows you how it can be changed to add software installed in a new location. \n" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "from IPython.display import YouTubeVideo\n", "YouTubeVideo(\"2OXvoXejZcw\",width=640,height=360)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Commands used in the above video\n", "\n", "```\n", " ls\n", " clear\n", " which python\n", " cd\n", " env\n", " echo $PATH\n", " echo $PATH | sec -r \"s/:/\\\\n/g\"\n", " export PATH=~/anaconda3/bin:$PATH\n", " ssh dev-intel16\n", " nano ~/.bashrc\n", "```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "✅ **QUESTION:** What is the ```which``` command used for?" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Put your answer to the above question here." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "✅ **QUESTION:** The PATH environment variable is a set of system folders separated by a colon (:). What command would you use to add the ```/mnt/research/mygroup/bin``` folder to the end of your path?" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Put your answer to the above question here." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The following video shows some basics on how to use the ```module``` command that is available on the HPCC. " ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "from IPython.display import YouTubeVideo\n", "YouTubeVideo(\"lXYpQeU3j-0\",width=640,height=360)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Commands used in the above video\n", "\n", "```\n", " ssh dev-intel16\n", " clear\n", " who | wc -l\n", " module list\n", " module spider MATLAB\n", " module unload MATLAB\n", " module load MATLAB/2018b\n", " which matlab\n", " module swap MATLAB/2018b MATLAB/2018a\n", " module avail\n", " module unload gnu\n", " module load intel\n", " module show intel\n", " module purge\n", "```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "✅ **QUESTION:** Use the ```module spider``` command to search modules. What versions of the libpng are available on the HPCC? (**Note**: if the modules have changed since the last time you used the ```module spider``` command it may need to rebuild it's database which can take a few seconds). " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Put the answer to the above question here. " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "\n", "\n", "---\n", "\n", "# 3. Assignment wrap up\n", "\n", "\n", "Please fill out the form that appears when you run the code below. **You must completely fill this out in order to receive credits for the assignment!**\n", "\n", "[Direct Link to Survey Form](https://cmse.msu.edu/cmse401-pc-survey)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "✅ **Assignment-Specific QUESTION:** Why do you think MSU's HPCC has the module system to load in specific modules rather than just having everything loaded in by default?" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Put your answer to the above question here" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "from IPython.display import HTML\n", "HTML(\n", "\"\"\"\n", "\n", "\"\"\"\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "\n", "---------\n", "### Congratulations, we're done!\n", "\n", "To get credit for this assignment you must fill out and submit the above survey from on or before the assignment due date." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Written by Dr. Dirk Colbry, Michigan State University. Updated by Dr. Nathan Haut in Spring 2025.\n", "\"Creative
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "----" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "----" ] } ], "metadata": { "anaconda-cloud": {}, "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.9.13" } }, "nbformat": 4, "nbformat_minor": 2 }