How to append the result from each iteration into the CSV file?
0
I am sending the numerical field into for loop and calculating the max, min and percentile. I want to store each result (last print statement) into the csv file. I am literally struck here.
Each iteration in the for loop prints result like below:
emp_id, 10, 23, 45.4
I want to save these results in a csv file.
import pandas as pd
import numpy as np
data = pd.read_csv(r'C:Usersspanda031Downloadstest_19.csv')
#abc=data.dtypes
#print(abc)
df = data.select_dtypes(include='number')
cols = df.columns.values
print(cols)
arr = df.values
#print("new array ", arr)
#with open(r'C:Usersspanda031Downloadstest_19.csv') as f:
# d_reader = csv.DictReader(f)
#get fieldnames from DictReader object and store in list
# headers = d_reader.fieldnames
# print(headers)
for line in cols:
#print value in MyCol1 for each row
#print(line)
v3=np.array(data[line])
#print(v3)
print(line,",",v3.min(),",",v3.max(),",",np.percentile(v3, 25))
python pandas dataframe
edited Nov 15 '18 at 18:01
martineau
69k1091186
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
add a comment |
0
I am sending the numerical field into for loop and calculating the max, min and percentile. I want to store each result (last print statement) into the csv file. I am literally struck here.
Each iteration in the for loop prints result like below:
emp_id, 10, 23, 45.4
I want to save these results in a csv file.
import pandas as pd
import numpy as np
data = pd.read_csv(r'C:Usersspanda031Downloadstest_19.csv')
#abc=data.dtypes
#print(abc)
df = data.select_dtypes(include='number')
cols = df.columns.values
print(cols)
arr = df.values
#print("new array ", arr)
#with open(r'C:Usersspanda031Downloadstest_19.csv') as f:
# d_reader = csv.DictReader(f)
#get fieldnames from DictReader object and store in list
# headers = d_reader.fieldnames
# print(headers)
for line in cols:
#print value in MyCol1 for each row
#print(line)
v3=np.array(data[line])
#print(v3)
print(line,",",v3.min(),",",v3.max(),",",np.percentile(v3, 25))
python pandas dataframe
edited Nov 15 '18 at 18:01
martineau
69k1091186
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
1
You're probably looking for either the csv module or the numpy tofile functionality
– G. Anderson
Nov 15 '18 at 17:13
You can usepython your_script.py >> your_file.csvto append to an existing file.
– Austin Salonen
Nov 15 '18 at 17:19
Actually i am going to run the python script as standalone resource and i will create hive table on top of that csv file
– Shankar Panda
Nov 15 '18 at 17:20
add a comment |
0
0
0
I am sending the numerical field into for loop and calculating the max, min and percentile. I want to store each result (last print statement) into the csv file. I am literally struck here.
Each iteration in the for loop prints result like below:
emp_id, 10, 23, 45.4
I want to save these results in a csv file.
import pandas as pd
import numpy as np
data = pd.read_csv(r'C:Usersspanda031Downloadstest_19.csv')
#abc=data.dtypes
#print(abc)
df = data.select_dtypes(include='number')
cols = df.columns.values
print(cols)
arr = df.values
#print("new array ", arr)
#with open(r'C:Usersspanda031Downloadstest_19.csv') as f:
# d_reader = csv.DictReader(f)
#get fieldnames from DictReader object and store in list
# headers = d_reader.fieldnames
# print(headers)
for line in cols:
#print value in MyCol1 for each row
#print(line)
v3=np.array(data[line])
#print(v3)
print(line,",",v3.min(),",",v3.max(),",",np.percentile(v3, 25))
python pandas dataframe
edited Nov 15 '18 at 18:01
martineau
69k1091186
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
I am sending the numerical field into for loop and calculating the max, min and percentile. I want to store each result (last print statement) into the csv file. I am literally struck here.
Each iteration in the for loop prints result like below:
emp_id, 10, 23, 45.4
I want to save these results in a csv file.
import pandas as pd
import numpy as np
data = pd.read_csv(r'C:Usersspanda031Downloadstest_19.csv')
#abc=data.dtypes
#print(abc)
df = data.select_dtypes(include='number')
cols = df.columns.values
print(cols)
arr = df.values
#print("new array ", arr)
#with open(r'C:Usersspanda031Downloadstest_19.csv') as f:
# d_reader = csv.DictReader(f)
#get fieldnames from DictReader object and store in list
# headers = d_reader.fieldnames
# print(headers)
for line in cols:
#print value in MyCol1 for each row
#print(line)
v3=np.array(data[line])
#print(v3)
print(line,",",v3.min(),",",v3.max(),",",np.percentile(v3, 25))
python pandas dataframe
python pandas dataframe
edited Nov 15 '18 at 18:01
martineau
69k1091186
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
edited Nov 15 '18 at 18:01
martineau
69k1091186
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
edited Nov 15 '18 at 18:01
martineau
69k1091186
edited Nov 15 '18 at 18:01
martineau
69k1091186
edited Nov 15 '18 at 18:01
martineau
69k1091186
69k1091186
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
asked Nov 15 '18 at 17:07
Shankar PandaShankar Panda
1741115
1741115
1
You're probably looking for either the csv module or the numpy tofile functionality
– G. Anderson
Nov 15 '18 at 17:13
You can usepython your_script.py >> your_file.csvto append to an existing file.
– Austin Salonen
Nov 15 '18 at 17:19
Actually i am going to run the python script as standalone resource and i will create hive table on top of that csv file
– Shankar Panda
Nov 15 '18 at 17:20
add a comment |
1
You're probably looking for either the csv module or the numpy tofile functionality
– G. Anderson
Nov 15 '18 at 17:13
You can usepython your_script.py >> your_file.csvto append to an existing file.
– Austin Salonen
Nov 15 '18 at 17:19
Actually i am going to run the python script as standalone resource and i will create hive table on top of that csv file
– Shankar Panda
Nov 15 '18 at 17:20
1
1
You're probably looking for either the csv module or the numpy tofile functionality
– G. Anderson
Nov 15 '18 at 17:13
You're probably looking for either the csv module or the numpy tofile functionality
– G. Anderson
Nov 15 '18 at 17:13
You can use
python your_script.py >> your_file.csv to append to an existing file.– Austin Salonen
Nov 15 '18 at 17:19
You can use
python your_script.py >> your_file.csv to append to an existing file.– Austin Salonen
Nov 15 '18 at 17:19
Actually i am going to run the python script as standalone resource and i will create hive table on top of that csv file
– Shankar Panda
Nov 15 '18 at 17:20
Actually i am going to run the python script as standalone resource and i will create hive table on top of that csv file
– Shankar Panda
Nov 15 '18 at 17:20
add a comment |
1 Answer
1
active
oldest
votes
0
This way i could resolve it.
res_df=line,v3.min(),v3.max(),np.percentile(v3, 25),np.std(v3)
with open('C:\Users\spanda031\Downloads\abccc.csv', 'a', newline='') as csvfile:
writerows = csv.writer(csvfile, delimiter=',',
quotechar='"', quoting=csv.QUOTE_MINIMAL)
writerows.writerow(map(lambda x: x, res_df))
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53324603%2fhow-to-append-the-result-from-each-iteration-into-the-csv-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
0
This way i could resolve it.
res_df=line,v3.min(),v3.max(),np.percentile(v3, 25),np.std(v3)
with open('C:\Users\spanda031\Downloads\abccc.csv', 'a', newline='') as csvfile:
writerows = csv.writer(csvfile, delimiter=',',
quotechar='"', quoting=csv.QUOTE_MINIMAL)
writerows.writerow(map(lambda x: x, res_df))
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
add a comment |
0
This way i could resolve it.
res_df=line,v3.min(),v3.max(),np.percentile(v3, 25),np.std(v3)
with open('C:\Users\spanda031\Downloads\abccc.csv', 'a', newline='') as csvfile:
writerows = csv.writer(csvfile, delimiter=',',
quotechar='"', quoting=csv.QUOTE_MINIMAL)
writerows.writerow(map(lambda x: x, res_df))
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
add a comment |
0
0
0
This way i could resolve it.
res_df=line,v3.min(),v3.max(),np.percentile(v3, 25),np.std(v3)
with open('C:\Users\spanda031\Downloads\abccc.csv', 'a', newline='') as csvfile:
writerows = csv.writer(csvfile, delimiter=',',
quotechar='"', quoting=csv.QUOTE_MINIMAL)
writerows.writerow(map(lambda x: x, res_df))
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
This way i could resolve it.
res_df=line,v3.min(),v3.max(),np.percentile(v3, 25),np.std(v3)
with open('C:\Users\spanda031\Downloads\abccc.csv', 'a', newline='') as csvfile:
writerows = csv.writer(csvfile, delimiter=',',
quotechar='"', quoting=csv.QUOTE_MINIMAL)
writerows.writerow(map(lambda x: x, res_df))
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
answered Nov 15 '18 at 17:59
Shankar PandaShankar Panda
1741115
1741115
add a comment |
add a comment |
draft saved
draft discarded
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53324603%2fhow-to-append-the-result-from-each-iteration-into-the-csv-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
You're probably looking for either the csv module or the numpy tofile functionality
– G. Anderson
Nov 15 '18 at 17:13
You can use
python your_script.py >> your_file.csvto append to an existing file.– Austin Salonen
Nov 15 '18 at 17:19
Actually i am going to run the python script as standalone resource and i will create hive table on top of that csv file
– Shankar Panda
Nov 15 '18 at 17:20