Midterm Test

The midterm test is over chapters 1-5. Please use this template and answer the questions on this form. Place your name at the top of this page prior to submitting (or add a cover page to this paper),

1. For each of the datasets note if data privacy is an important issue

a. Census data collected from 1900- 1950

b. IP addresses and visit times of web users who visit your website.

c. Images from Earth orbiting satellites

d. Names and addresses of people from the telephone book

e. Names and email addresses collected from the web.

2. Classify the following attributes as binary, discrete, or continuous. Also classify them as qualitative (nominal or ordinal) or quantitative (interval or ratio). Some cases may have more than one interpretation, so briefly indicate your reasoning if you think there may be some ambiguity. 

Example: Age in years. Answer: Discrete, quantitative, ratio 

(a) Time in terms of AM or PM. 

(b) Brightness as measured by a light meter. 

(c) Brightness as measured by people’s judgments.

(d) Angles as measured in degrees between 0◦ and 360◦. 

(e) Bronze, Silver, and Gold medals as awarded at the Olympics. 

(f) Height above sea level. 

(g) Number of patients in a hospital. 

(h) ISBN numbers for books. (Look up the format on the Web.) 

(i) Ability to pass light in terms of the following values: opaque, translucent, transparent. 

(j) Military rank. 

(k) Distance from the center of campus. 

(l) Density of a substance in grams per cubic centimeter. 

(m) Coat check number. (When you attend an event, you can often give your coat to someone who, in turn, gives you a number that you can use to claim your coat when you leave.) 

3. Which of the following quantities is likely to show more temporal autocorrelation: daily rainfall or daily temperature? Why? 

4. Distinguish between noise and outliers. Be sure to consider the following questions. 

a. Is noise ever interesting or desirable? Outliers? 

b. Can noise objects be outliers? 

c. Are noise objects always outliers? 

d. Are outliers always noise objects? 

e. Can noise make a typical value into an unusual one, or vice versa? 

5. Discuss the advantages and disadvantages of using sampling to reduce the number of data objects that need to be displayed. Would simple random sampling (without replacement) be a good approach to sampling? Why or why not? 

6. How might you address the problem that a histogram depends on the number and location of the bins?

7. Show that the entropy of a node never increases after splitting it into smaller successor nodes.

8. Compute a two-level decision tree using the greedy approach described in this chapter. Use the classification error rate as the criterion for splitting. What is the overall error rate of the induced tree?

9. Consider a binary classification problem with the following set of attributes and attribute values: 

• Air Conditioner = {Working, Broken} 

• Engine = {Good, Bad} 

• Mileage = {High, Medium, Low} 

• Rust = {Yes, No} 

Suppose a rule-based classifier produces the following rule set:

Mileage = High −→ Value = Low 

Mileage = Low −→ Value = High 

Air Conditioner = Working, Engine = Good −→ Value = High 

Air Conditioner = Working, Engine = Bad −→ Value = Low 

Air Conditioner = Broken −→ Value = Low (

a) Are the rules mutually exclusive? Answer: No

b) Is the rule set exhaustive? Answer: Yes

c) Is ordering needed for this set of rules? Answer: Yes because a test instance may trigger more than one rule. 

d) Do you need a default class for the rule set? Answer: No because every instance is guaranteed to trigger at least one rule. 46 Chapter 5 Classification: Alternative Technique

10. Consider the one-dimensional data set shown below: 

X

.5

3.0

4.5

4.6

4.9

5.2

5.3

5.5

7.0

9.5

Y

–

–

+

+

+

–

–

+

–

–

(a) Classify the data point x = 5.0 according to its 1-, 3-, 5-, and 9-nearest neighbors (using majority vote). 

(b) Repeat the previous analysis using the distance-weighted voting approach.

Project Part 3: System Hardening and Auditing

Scenario

Fullsoft’s chief technology officer (CTO) established a plan to mitigate risks, threats, and vulnerabilities. As part of the mitigation plan, you and your team members will configure baseline security controls on all workstations (harden the systems), which run either Windows 7 or Windows 10. For this effort, you will ensure that the antivirus software is running properly and implement a control related to password-hacking attempts.In addition, Fullsoft’s CTO has asked your team to pay special consideration to continuously monitoring, testing, and improving countermeasures. The CTO points out that within the first 24 hours of configuring baseline security, you may sometimes receive alerts that malware has been quarantined within an antivirus program or notice a failed logon attempt captured by the Windows audit log. In response, you make a note to check the security of the workstation for which you will configure baseline security.The CTO also requests a report on the work you performed, part of which will be incorporated into the company’s IT security policy procedures. The report should also include the purposes of system hardening and auditing, and an additional area of concern or emerging trend related to information systems security that’s relevant to Fullsoft.At the end of the report, include a brief statement that explains how your work on this project relates to the larger responsibility you have for supporting the company’s success regarding IT security. Your statement will be considered a part of your upcoming performance review.

Tasks

If possible, complete the hardening and auditing tasks using a personal computer with the default installation of Windows 7 or Windows 10. If you do not own the necessary hardware and software, consult with your instructor about alternatives. After your work on this project is complete, you may need to return the settings to the previous configuration.

1. Ensure that you are logged in as an administrator. Using a computer that has Windows 7 or Windows 10 installed:
   1. Review the antivirus program. Ensure that it is up to date, is configured for automatic updates, and is scheduled to run quick scans regularly. Note when the last full system scan was run and any issues you observe with the software.
   2. Configure audit logging to identify all failed password attempts into the system.
2. After at least 24 hours, check the Windows workstation for security events. Be sure to review the audit log in Windows Event Viewer.
3. Write a report in which you:
   • Explain how you ensured the antivirus program is up to date, scheduled to run regular quick scans, and when the last full system scan was run. Describe anything significant you observed.
   • Explain how you configured audit logging to record all failed password attempts into the system.
   • Describe all the potentially problematic security events that occurred in the 24-hour period after checking the antivirus software and configuring audit logging.

Project: Information Systems Security
Explain what was done (or should be done) to correct any problems encountered.
Explain the purposes of system hardening and auditing in terms of the company’s goal of maintaining information systems security. Also describe an additional area of concern or an emerging trend related to information systems security that you think warrants the company’s attention in the immediate future. Discuss some relevant hardening guidance Fullsoft could implement.
Briefly explain how your work on this project relates to your responsibility to help the company achieve its IT security goals.

Required Resources

• Textbook for this course
• A Windows 7 or Windows 7 computer, preferably with a default installation
• Internet access

Additional Resources

• Audit logon events
• How to See Who Logged Into a Computer and When
• Event Logs
• Using Event Viewer to Troubleshoot Problems

Submission Requirements

• Format: Microsoft Word or compatible
• Font: APA Format
• Citation Style: APA Format
• Submit in the Group Project Part 3 Assignment
• Name the document Group-project-part-3
• Length: 5–6 pages plus citation page
• Include relevant screenshots

You are encouraged to respond creatively, but you must cite credible sources to support your work.

Self-Assessment Checklist

• I summarized the system-hardening and auditing configuration steps I implemented on a computer using Windows 7 or Windows 10, including:
  • How I ensured the antivirus software is running properly
  • How I configured audit logging of all failed password attempts
• I described potentially problematic security events that occurred within a 24-hour period, and noted actions that were taken (or should be taken) to address them.
• I explained the purposes of system hardening and auditing in terms of the company’s overarching goal of maintaining information systems security.
• I proposed at least one area of concern or emerging trend related to information systems security that warrants additional attention.
• I explained how my work on this project relates to my professional responsibility to help the company achieve its IT security goals.
• I conducted adequate independent research for this part of the project.
• I followed the submission guidelines.

Unit 2 Discussion: Through the Looking Glass

Unit 2 Discussion: Through the Looking GlassThis unit talks about perception, and what influences how we think of ourselves.How did watching the video about stranger’s interpretations of each other influence your thoughts on self-identity?

 (Utilize the components of identity from chapter 3 to add credibility to your response.)What steps could you take personally to enhance your self-esteem and self-identity?

 (Cite information from your textbook to back your response.) 

Title: Design and develop a Distributed Recommendation System on Hadoop

Problem statement: 

 Given 2 CSV data sets: 

(a) A course dataset containing details of courses offered

(b) A job description dataset containing a list of job descriptions 

(Note: Each field of a job description record is demarcated by ” “)

You have to design and implement a distributed recommendation system using the data sets, which will recommend the best courses for up-skilling based on a given job description. You can use the data set to train the system and pick some job descriptions not in the training set to test. 

It is left up to you how you pick necessary features and build the training that creates matching courses for job profiles.

Use Map Reduce and Python

NOTE: Combine all data_job_posts.csv into a single CSV file. Due to size limitation, I had to split the file