Problem 1  Automatically collect from memphis.edu 10,000 

unique documents. The documents should be proper after converting them to txt 

(>50 valid tokens after saved as text); only collect .html, .txt, and and .pdf 

web files and then convert them to text - make sure you do not keep any of 

the presentation tags such as html tags. You may use third party tools to 

convert the original files to text. Your output should be a set of 10,000 text 

files (not html, txt, or pdf docs) of at least 50 textual tokens each. You must 

write your own code to collect the documents - DO NOT use an existing or third party crawlercrawler.



Store for each proper file the original URL as you will need it later 

when displaying the results to the user.

Problem 2  Preprocess all the files using assignment #4( "python program that preprocesses a 

collection of documents using the recommendations given in the 

Text Operations lecture. The input to the program will be a directory

containing a list of (10000 unique documents)text files collected in above program.  documents must be converted to text before using them.



Remove the following during the preprocessing:

- digits

- punctuation

- stop words (use the generic list available at ...ir-websearch/papers/english.stopwords.txt)

- urls and other html-like strings

- uppercases

- morphological variations).)" This directory should have index terms( inverted 

index of a set of already preprocessed files.Use raw term frequency (tf) in the document without normalizing it. Think about saving the generated index, including the document frequency (df), in a file so that you can retrieve it later) .Save all preprocessed documents in a single directory . 

• Explain how social engineering attacks work
• Describe virtual private networks
• Identify different access control models

Considering the importance of data in organization, it is absolutely essential to secure the data present in the database. What are the strategic and technical security measures for good database security? Be sure to discuss at least one security model to properly develop databases for organizational security. Create a diagram of a security model for your research paper.

Your paper should meet the following requirements:

• Be approximately four to six pages in length, not including the required cover page and reference page.
• Follow APA7 guidelines. Your paper should include an introduction, a body with fully developed content, and a conclusion.
• Support your answers with the readings from the course and at least two scholarly journal articles to support your positions, claims, and observations, in addition to your textbook. The UC Library is a great place to find resources.
• Be clearly and well-written, concise, and logical, using excellent grammar and style techniques. You are being graded in part on the quality of your writing.

Milestones complete 3 documents:

· Document 1 Introduction Section – A 2-3 page paper describing the industry chosen and potential resources to be used. 100 pts.

· Document 2 Develop a full annotated bibliography (3-4 pages) and develop the literature review (3-4  pages). 200 pts.(7-8 pages total)

· Document 3 combined with Completed final research paper (both milestones combined and including the last sections as discussed in the list above). 300 pts.

Requirements:

The papers should include at a minimum of the following sections:

a. Title page

b. Executive Summary (Abstract)

c. Body

i. Introduction (including industry discussion – 2-3 pages)(Should be present in document 1 and combined final paper)

ii. Annotated Bibliography (3-4 pages (Should be present in document 2 and combined final paper)

iii. Literature review (Should be present in document 2 and combined final paper)

iv. Completed Final paper should include Program and technology recommendations, including:

1. Metrics

2. Data that matters to the executives in that industry, the roles for those executives, and some methods for getting this data into their hands.

3. Regulatory, security, and privacy compliance expectations for your company

4. Email and social media strategy

5. Cloud Computing strategy

d. Conclusion

e. References

2. You must include at least two figures or tables in the completed final paper. These must be of your own creation. Do not copy from other sources.

Must cite at least 10 references and 5 must be from peer reviewed scholarly journals (accessible from the UC Library)( https://www.ucumberlands.edu/library).

3. Completed final paper should be in proper APA format and avoid plagiarism when paraphrasing content. It should be a minimum of 12-14 pages in length (double-spaced), excluding the title page and references.

Milestones complete 3 documents:

· Document 1 Introduction Section – A 2-3 page paper describing the industry chosen and potential resources to be used. 100 pts.

· Document 2 Develop a full annotated bibliography (3-4 pages) and develop the literature review (3-4  pages). 200 pts.(7-8 pages total)

· Document 3 combined with Completed final research paper (both milestones combined and including the last sections as discussed in the list above). 300 pts.

Requirements:

The papers should include at a minimum of the following sections:

a. Title page

b. Executive Summary (Abstract)

c. Body

i. Introduction (including industry discussion – 2-3 pages)(Should be present in document 1 and combined final paper)

ii. Annotated Bibliography (3-4 pages (Should be present in document 2 and combined final paper)

iii. Literature review (Should be present in document 2 and combined final paper)

iv. Completed Final paper should include Program and technology recommendations, including:

1. Metrics

2. Data that matters to the executives in that industry, the roles for those executives, and some methods for getting this data into their hands.

3. Regulatory, security, and privacy compliance expectations for your company

4. Email and social media strategy

5. Cloud Computing strategy

d. Conclusion

e. References

2. You must include at least two figures or tables in the completed final paper. These must be of your own creation. Do not copy from other sources.

Must cite at least 10 references and 5 must be from peer reviewed scholarly journals (accessible from the UC Library)( https://www.ucumberlands.edu/library).

3. Completed final paper should be in proper APA format and avoid plagiarism when paraphrasing content. It should be a minimum of 12-14 pages in length (double-spaced), excluding the title page and references.