amazon s3 - Python Write Temp File to S3 -

-

i trying write dataframe temp file , upload temp file s3 bucket. when run code there isn't action occurs. appreciated. following code:

import csv import pandas pd import boto3 import tempfile import os    temp = tempfile.temporaryfile() largedf.to_csv(temp, sep = '|') s3.put_object(temp, bucket = '[bucket name]', key = 'test.txt') temp.close()

the file-handle pass s3.put_object @ final position, when .read it, return empty string.

>>> df = pd.dataframe(np.random.randint(10,50, (5,5))) >>> temp = tempfile.temporaryfile(mode='w+') >>> df.to_csv(temp) >>> temp.read() ''

a quick fix .seek beginning...

>>> temp.seek(0) 0 >>> print(temp.read()) ,0,1,2,3,4 0,11,42,40,45,11 1,36,18,45,24,25 2,28,20,12,33,44 3,45,39,14,16,20 4,40,16,22,30,37

note, writing disk unnecessary, really, keep in memory using buffer, like:

from io import stringio # on python 2, use cstringio import stringio buffer = stringio() pd.to_csv(buffer) buffer.seek(0) s3.put_object(buffer, bucket = '[bucket name]', key = 'test.txt')

Comments

Post a Comment

Popular posts from this blog

ios - MKAnnotationView layer is not of expected type: MKLayer -

-
Image
so code works fine logger riddled message. there way rid of or suppress it? postannotation.swift class postannotation: mkpointannotation { //mark: properties let post: post //mark: initialization init(post: post) { self.post = post super.init() self.coordinate = cllocationcoordinate2d(latitude: post.latitude, longitude: post.longitude) self.title = post.title self.subtitle = post.timestring() } } adding annotation let annotation = postannotation(post: post) self.map.addannotation(annotation) func mapview func mapview(_ mapview: mkmapview, viewfor annotation: mkannotation) -> mkannotationview? { if annotation mkuserlocation { return nil } var annotationview = mapview.dequeuereusableannotationview(withidentifier: "pin") as? mkpinannotationview if annotationview == nil { annotationview = mkpinannotationview(annotation: annotation, reuseidentifier: "pin")
Read more

ZeroMQ on Windows, with Qt Creator -

-
i have installed zmq link given below on windows 7. http://zeromq.org/distro:microsoft-windows 1) have c++ project in qt-creator , i'm using zmq c++ binding (zhelpers.hpp etc). 2) have added .lib installed zmq folder qtcreator 3) while compiling, compiler looks _imp__zmq_verion, in .dll files present in .lib have __imp_zmq_version. 4) causing undefined reference zmq_version. anyone else faced problem , has solution ?
Read more

unity3d - Unity SceneManager.LoadScene quits application -

-
i have 2 different scenes 1 named 'main' , other 'game' both added scenes in load. when use scenemanager.loadscene("game"); works no problem when tried return main scene code if (input.getkeydown (keycode.escape)) { scenemanager.loadscene("main"); } strangely game quits. thanks. sorry interruption. somewhere on other script found code. if (input.getkeydown (keycode.escape)) { application.quit (); } that's bad, know...
Read more