sci论文代写,sci代写,sci代发

CSCI-UA.0480-057

Homework Number 5

CSCI Create a program that takes a fifile like WSJ_02-21.pos-chunk as input and produces a fifile consisting of feature value pairs for use

1.You will write a Noun Group tagger, using similar data that you used for Homework 3. However, for this program we will  focus more on feature selection than on an algorithm.

1.Download the WSJ_CHUNKFILES.zip from NYUClasses (Resources). This includes the following data fifiles

1. WSJ_02-21.pos-chunk -- the training fifile


2. WSJ_24.pos -- the development fifile that you will test your system on


3. WSJ_24.pos-chunk -- the answer key to test your system output against


4. WSJ_23.pos -- the test fifile, to run your fifinal system on, producing system output

2.Download MAX_ENT_fifiles.zip, also from NYUClasses resources. This includes the following program fifiles (using the OpenNLP package):

1. maxent-3.0.0.jar, MEtag.java. MEtrain.java and trove.jar -- Java fifiles for running the maxent training and classifification programs

2. score.chunk.py -- A python scoring script


3. Create a program that takes a fifile like WSJ_02-21.pos-chunk as input and produces a fifile consisting of feature value pairs for use with the maxent trainer and classififier. As this step represents the bulk of the assignment, there will be more details below, including the format information, etc. This program should create two output fifiles. From the training corpus (WSJ_02-21.pos-chunk), create a training feature fifile (training.feature). From the development corpus (WSJ_24.pos), create a test feature fifile (test.feature). See details below.

4. Compile and run MEtrain.java, giving it the feature-enhanced training fifile as input; it will produce a MaxEnt model. MEtrain and MEtest use the maxent and trove packages, so you must include the corresponding jar fifiles, maxent-3.0.0.jar and trove.jar, on the classpath when you compile and run. Assuming all java fifiles are in the same directory, the following command-line commands will compile and run these programs -- these commands are slightly different for posix systems (Linux or Apple), than for Microsoft Windows.

1.For Linux, Apple and other Posix systems, do:  CSCI

1. javac -cp maxent-3.0.0.jar:trove.jar *.java ### compiling


2. java -cp .:maxent-3.0.0.jar:trove.jar MEtrain training.feature

model.chunk ### creating the model of the training data

3. java -cp .:maxent-3.0.0.jar:trove.jar MEtag test.feature model.chunk response.chunk ### creating the system output

2.For Windows Only -- Use semicolons instead of colons in each of the above commands, i.e., the command for Windows would be:

1. javac -cp maxent-3.0.0.jar;trove.jar *.java ### compiling


2. java -cp .:maxent-3.0.0.jar;trove.jar MEtrain training.chunk model.chunk ### creating the model of the training data

3. java -cp .:maxent-3.0.0.jar;trove.jar MEtag test.chunk model.chunk response.chunk ### creating the system output

3.Quick Fixes

• If the system is running out of memory, you can specify how much RAM java uses. For example, java -Xmx16g -cp ... will use 16 gigabytes of RAM.


• If your system cannot fifind java fifiles or packages and just doesn't run for that reason, the easiest fifix is to run (the java steps) on one of NYU's linux servers. Accounts can be made available to all students in this class. Alternatively, you can make sure that all path variables are set properly, that java is properly installed, etc.

5.Score your results with the python script as follows:

• python score.chunk.py WSJ_24.pos-chunk response.chunk ### WSJ_24.pos-chunk is the answer key and response.chunk is your outputfifile

6.When you are done creating your system, create a test.feature fifile from the test corpus (WSJ_23.pos) and execute step 1.4.1.3 (or 1.4.2.3) to create your fifinal response fifile (WSJ_23.chunk). Your submission to gradescope must  contain the fifile WSJ_23.chunk or it will not be able to grade your work.

7.This pipeline is set up so you can write the code for producing the feature fifiles in any programming language you wish. You have the alternative of using any Maxent package you would like, provided that the scoring script works on your output.

2.As mentioned in section 1.3, you are primarily responsible for a program that creates sets of features for the Maximum Entropy system. CSCI

1.Format Information:

1. There should be 1 corresponding line of features for each line in the input fifile (training or test)

•   If the input and feature fifiles have different numbers of lines,  you have a bug

2. Blank lines in the input fifile should correspond to blank lines in your feature fifile

3. Each line corresponding to text should contain tab separated values as follows:

1. the fifirst fifield should be the token (word, puncutation, etc.)


2. this should be followed by as many features as you want (but no feature should contain white space). Typically, features are recommended to have the form attribute=value, e.g., POS=NN

• This makes the features easy for humans to understand, but isnot actually required by the program, e.g., the code does not look for the = sign.

3. for the training fifile only, the last fifield should be the BIO tag (B-NP, I-NP or O)

4. for the test fifile, there should be no fifinal BIO fifield (as there is nonein the .pos fifile that you would be training from)

5. A sample training fifile line (where \t represents tab): 'fifish\tPOS=NN\tprevious_POS=DT\tprevious_word=the\tI-NP ## actual lines will probably be longer

4. There is a special symbol '@@' that you can use to refer to the previous BIO tag, e.g., Previous_BIO=@@

• This allows you to simulate a (bigram) MEMM because you can refer to the previous BIO tag

2.Suggested features:   CSCI

1. Features of the word itself: POS, the word itself, stemmed version of the word

2. Similar features of previous and/or following words (suggestion: use the features of previous word, 2 words back, following word, 2 words forward)

3. Beginning/Ending Sentence (at the beginning of the sentence, omit features of 1 and 2 words back; at end of sentence, omit features of 1 and 2 words forward)

4. capitalization, features of the sentence, your own special dictionary, etc.

3.When you have completed the assignment, submit the following in a zip fifile through GradeScope (link to be added):

1. Your code


2. A short write-up describing the features you tried and your score on the development corpus.

3. Your output fifile from the test corpus, i.e., WSJ_23.chunk. Your submission to gradescope must contain the fifile WSJ_23.chunk or it will not be able to grade your work.

4.Understanding the scoring:  CSCI

1. Accuracy = (correct BIO tags)/Total BIO Tags


2. Precision, Recall and F-measure measure Noun Group performance: A noun group is correct if it in both the system output and the answer key.

1. Precision = Correct/System_Output


2. Recall = Correct/Answer_key


3. F-measure = Harmonic mean of Precision and Recall

5.Evaluation: A simple system should achieve about 90% F-measure. It is possible, but diffificult to obtain 95-96%. Your grade will be judged as follows:

1. Your system's score


2. The innovativeness of your features


3. Any interesting analysis that you do

商科代写 cs代写 法律学代写 经济学代考_经济学作业代写 艺术代写 心理学代写  哲学代写 伦理学代写 体育学代写 化学代写 教育学代写 医学代写 历史代写 地理学代写