7/5/17 Notes (Adding a column with the year in it and merging all the files together)

Trying to make a column in the confidences14 dataframe that has “2013-14” in each cell.
  • I tried a command I found online here is what I typed:
    • ConfidenceS14['Year'] = Series(np.random.randn(sLength), index=ConfidenceS14.index)
    • I got an error saying “series” was not defined, I’m not sure what I should put there
    • I tried putting ‘Year’ where series was and ‘[39]’ where sLength was (# of rows) this gave me an error that said “need integer”
    • Tried changing command to this:
      • ConfidenceS14['Year'] = 'Year'([2013-14]([39]), index=ConfidenceS14.index)
    • I got an error that says “'list' object is not callable”
  • I tried a simpler command I found online and it worked!
    • ConfidenceS14['Year'] = '2013-14'
Merged ConfidenceS14 with ConfidenceS15 here is the command I used
  • Confidence1415 = pd.merge(left=ConfidenceS14,right=ConfidenceS15, on=['First Name','Last Name'], how='outer')
    • I used an outer merge so I could keep all data, even the ones that didn’t match up.
When I tried to merge the file with every survey year to the Attendance file I got an error that said “Year Participated” I think this might be because there are too many “Year Participated” columns in the file with all the surveys so instead of merging all the surveys together, then merging that with the attendance, I’m going to merge the survey files for each year with the attendance, then merge the files from each year together to make one file to rule them all.
  • I’m still having a problem with “Year Participated” I’m going to restart Kernel and clear outputs, and try again. This worked!

I merged all the files and when I searched for a name, I got the multiples of the same name for the same year so I need to edit the command I used earlier that deletes duplicates for same name and year. This worked!

Comments

Post a Comment

Popular posts from this blog

6/14/17 Notes

I want to write a code so that I can search the name of a class, and everyone who took that class will appear. Originally I assumed I could use the same command I did to search for a specific name, and then edit that so the code would search for a specific person. However, looking at the format of the file, there are four different columns that contain class information, while there’s only one column with name information. I am going to see if I can search for a specific class in the “Am S1” column first to see if everything runs smoothly, and if that works, I will look for ways to search for an ID word in multiple columns. I tried this command. Only the column headings are appearing and nothing else Studentinfo14[Studentinfo14['Am S1'].str.contains('Discovery', na=False)] I changed “Studentinfo14” to attendance so that the code would look for this information in the attendance file instead of the master file. This worked, but using this file means that I ca...
Read more

6/06/17 Notes (formatting code and searching for a specific person)

Working on fixing the format of the code, deleting cells, and making sure everything in an organized order to make it easier to use Earlier I was having a problem displaying the Confidence survey chart so I renamed all the columns and then it displayed. I now found that the command “ConfidenceS#.lock[:,:] also works, and is much more efficient because now I don’t have to go through each survey and copy and past the column names for every year of every survey. This works for all of them except Semantics, not sure why. I finished adding all the survey information I needed to merge all the surveys for 2014. I keep getting errors in the cells that deal with inverting numbered responses because certain column headers “don’t exist.” This means I actually will have to rename all the columns. However, for some reason this does not affect the cells that merge all the data. I successfully uploaded all the files onto the code and merged all the surveys and the attendance spreadsheet to...
Read more

May 22, 2017 -- SienaSemanticsSurvey -- Code Breakdown -- Cell #8

Image
Information on Counter Counter: container that keeps track of how many times equivalent values are added. ScountsS14=coll.Counter(SemanticsS14.iloc[:,3])                                            ^ locates each student's data, but pulls out the 4th column (name of school)                       ^creates a collection of how many times student's listed the same school labels = list(set(SemanticsS14.iloc[:,3])                       ^ removes duplicates                 ^ creates a list n = len(labels)         ^ gives the length of the list found above                   ^ becomes representative of size which will be used below to distribute pieces of pie...
Read more